Apr 25 15:42:22 devstack cinder-volume[71833]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 25 15:42:22 devstack cinder-volume[71833]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 25 15:42:22 devstack cinder-volume[71833]: we strongly recommend against using it for new projects. Apr 25 15:42:22 devstack cinder-volume[71833]: If you are already using Eventlet, we recommend migrating to a different Apr 25 15:42:22 devstack cinder-volume[71833]: framework. For more detail see Apr 25 15:42:22 devstack cinder-volume[71833]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 25 15:42:22 devstack cinder-volume[71833]: import eventlet # noqa Apr 25 15:42:24 devstack cinder-volume[71833]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=71833) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 25 15:42:24 devstack cinder-volume[71833]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=71833) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 25 15:42:24 devstack cinder-volume[71833]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=71833) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 25 15:42:25 devstack cinder-volume[71833]: INFO dbcounter [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] Registered counter for database cinder Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_db.sqlalchemy.engines [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71833) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG dbcounter [-] [71833] Writer thread running {{(pid=71833) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 25 15:42:25 devstack cinder-volume[71833]: INFO cinder.rpc [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 25 15:42:25 devstack cinder-volume[71833]: INFO cinder.rpc [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_db.sqlalchemy.engines [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71833) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 25 15:42:25 devstack cinder-volume[71833]: INFO cinder.volume.manager [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] Determined volume DB was empty at startup. Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG cinder.volume.manager [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=71833) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 25 15:42:25 devstack cinder-volume[71833]: INFO cinder.volume.manager [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 25 15:42:25 devstack cinder-volume[71833]: WARNING stevedore.named [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 25 15:42:25 devstack cinder-volume[71833]: WARNING castellan.key_manager [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 25 15:42:25 devstack cinder-volume[71833]: WARNING cinder.keymgr.conf_key_mgr [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG cinder.volume.drivers.lvm [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=71833) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_concurrency.processutils [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=71833) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_concurrency.processutils [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] CMD "cinder-rtstool verify" returned: 0 in 0.240s {{(pid=71833) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_db.sqlalchemy.engines [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71833) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 25 15:42:25 devstack cinder-volume[71833]: INFO cinder.rpc [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 25 15:42:25 devstack cinder-volume[71833]: INFO cinder.rpc [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 25 15:42:25 devstack cinder-volume[71833]: WARNING stevedore.named [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 25 15:42:25 devstack cinder-volume[71833]: WARNING castellan.key_manager [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 25 15:42:25 devstack cinder-volume[71833]: INFO cinder.volume.manager [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_db.sqlalchemy.engines [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71833) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 25 15:42:25 devstack cinder-volume[71833]: INFO oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] Starting 1 workers Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] Started child 71938 {{(pid=71833) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] Full set of CONF: {{(pid=71833) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] ******************************************************************************** {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] Configuration options gathered from: {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] ================================================================================ {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 25 15:42:25 devstack cinder-volume[71938]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] allow_availability_zone_fallback = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] allow_compression_on_image_upload = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] allowed_direct_url_schemes = [] {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] api_rate_limit = True {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] auth_strategy = keystone {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] az_cache_duration = 3600 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_availability_zone = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_host = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_name = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_stats_polling_interval = 60 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backup_api_class = cinder.backup.api.API {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backup_name_template = backup-%s {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backup_use_same_host = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backup_use_temp_snapshot = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] chap_password = **** {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] chap_username = {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cinder_internal_tenant_project_id = 79df31b9be6c4bb4bea87087bba0cfd8 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cinder_internal_tenant_user_id = 2396e662689842b09266fbeda548f62a {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cloned_volume_same_az = True {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cluster = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] compression_format = gzip {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] compute_api_class = cinder.compute.nova.API {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] config_dir = [] {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] config_source = [] {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] control_exchange = openstack {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] debug = True {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] default_availability_zone = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] default_group_type = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] default_volume_type = lvmdriver-1 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] disk_geometry = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] driver_client_cert = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] driver_client_cert_key = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] driver_data_namespace = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] driver_ssl_cert_path = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] driver_ssl_cert_verify = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] driver_use_ssl = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] enable_force_upload = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] enable_new_services = True {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] enable_unsupported_driver = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] enabled_backends = ['lvmdriver-1'] {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] enforce_multipath_for_image_xfer = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] filter_function = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] glance_api_insecure = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] glance_api_servers = ['http://192.168.122.191/image'] {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] glance_api_ssl_compression = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] glance_ca_certificates_file = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] glance_catalog_info = image:glance:publicURL {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] glance_certfile = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] glance_keyfile = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] glance_num_retries = 3 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] glance_request_timeout = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] goodness_function = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] graceful_shutdown_timeout = 5 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] group_api_class = cinder.group.api.API {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] host = devstack {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] image_compress_on_upload = True {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] image_conversion_address_space_limit = 1 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] image_conversion_cpu_limit = 60 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] image_conversion_disable = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] image_upload_use_cinder_backend = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] image_upload_use_internal_tenant = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] image_volume_cache_enabled = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] image_volume_cache_max_count = 0 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] image_volume_cache_max_size_gb = 0 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] init_host_max_objects_retrieval = 0 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] instance_format = [instance: %(uuid)s] {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] iscsi_target_flags = {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] iscsi_write_cache = on {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] iser_helper = tgtadm {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71938]: INFO cinder.volume.manager [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] iser_ip_address = 192.168.122.191 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] iser_port = 3260 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] log_color = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] log_config_append = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] log_dir = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] log_file = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] log_options = True {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] log_rotate_interval = 1 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] log_rotate_interval_type = days {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] log_rotation_type = none {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] max_age = 0 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] max_logfile_count = 30 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] max_logfile_size_mb = 200 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] max_over_subscription_ratio = 20.0 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] message_reap_interval = 86400 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] message_ttl = 2592000 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] migration_create_volume_timeout_secs = 300 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] monkey_patch = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] monkey_patch_modules = [] {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] my_ip = 192.168.122.191 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] no_snapshot_gb_quota = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] num_iser_scan_tries = 3 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] num_shell_tries = 3 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] num_volume_device_scan_tries = 3 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] nvmeof_conn_info_version = 1 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] nvmet_ns_id = 10 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] nvmet_port_id = 1 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] osapi_max_limit = 1000 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] osapi_volume_ext_list = [] {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] osapi_volume_listen = 0.0.0.0 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] osapi_volume_listen_port = 8776 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] osapi_volume_use_ssl = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] osapi_volume_workers = 2 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] per_volume_size_limit = -1 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] periodic_fuzzy_delay = 60 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] periodic_interval = 60 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] project_id_regex = [0-9a-f\-]+ {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] public_endpoint = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] publish_errors = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] quota_backup_gigabytes = 1000 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] quota_backups = 10 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] quota_gigabytes = 1000 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] quota_groups = 10 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] quota_snapshots = 10 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] quota_volumes = 10 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] rate_limit_burst = 0 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] rate_limit_except_level = CRITICAL {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] rate_limit_interval = 0 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] reinit_driver_count = 3 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] replication_device = **** {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] report_discard_supported = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] report_interval = 120 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] reservation_clean_interval = 86400 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] reservation_expire = 86400 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] reserved_image_namespaces = [] {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] reserved_percentage = 0 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] rpc_response_timeout = 120 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] run_external_periodic_tasks = True {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] scst_target_driver = iscsi {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] scst_target_iqn_name = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] service_down_time = 720 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] shell_completion = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] snapshot_name_template = snapshot-%s {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] snapshot_same_host = True {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] split_loggers = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] state_path = /opt/stack/data/cinder {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] storage_availability_zone = nova {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] storage_protocol = iSCSI {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] syslog_log_facility = LOG_USER {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] target_helper = lioadm {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] target_ip_address = 192.168.122.191 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] target_port = 3260 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] target_protocol = iscsi {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] target_secondary_ip_addresses = [] {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] trace_flags = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] transfer_api_class = cinder.transfer.api.API {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] transport_url = **** {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] until_refresh = 0 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] use_chap_auth = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] use_default_quota_class = True {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] use_journal = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] use_json = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] use_multipath_for_image_xfer = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] use_stderr = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] use_syslog = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] verify_glance_signatures = enabled {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] volume_api_class = cinder.volume.api.API {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] volume_backend_name = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] volume_clear = zero {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] volume_clear_ionice = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] volume_clear_size = 0 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] volume_copy_bps_limit = 0 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] volume_dd_blocksize = 1M {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] volume_name_template = volume-%s {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] volume_service_inithost_offload = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] volume_usage_audit_period = month {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] zoning_mode = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_concurrency.disable_process_locking = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.admin_password = **** {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.admin_tenant_name = admin {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.admin_token = **** {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.admin_user = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.auth_admin_prefix = {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.auth_port = 35357 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.auth_protocol = https {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.auth_section = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.auth_type = password {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.auth_uri = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.auth_version = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.cache = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.certfile = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.delay_auth_decision = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.http_connect_timeout = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.identity_uri = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.include_service_catalog = True {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.insecure = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.interface = public {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.keyfile = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.memcache_password = {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.memcache_username = {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.region_name = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.service_token_roles_required = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.service_type = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.token_cache_time = 300 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.191/identity {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.backend = dogpile.cache.null {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.backend_argument = **** {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.backend_expiration_time = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.config_prefix = cache.oslo {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.debug_cache_backend = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.enable_retry_client = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.enable_socket_keepalive = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.enabled = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.enforce_fips_mode = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.expiration_time = 600 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.hashclient_retry_attempts = 2 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.memcache_dead_retry = 300 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.memcache_pool_maxsize = 10 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.memcache_sasl_enabled = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.password = **** {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.proxies = [] {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.redis_db = 0 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.redis_sentinel_service_name = mymaster {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.redis_server = localhost:6379 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.retry_attempts = 2 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.retry_delay = 0.0 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.socket_keepalive_count = 1 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.socket_keepalive_idle = 1 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.socket_keepalive_interval = 1 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.socket_timeout = 1.0 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.tls_allowed_ciphers = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.tls_cafile = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.tls_certfile = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.tls_enabled = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.tls_keyfile = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cache.username = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] coordination.backend_url = **** {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] database.asyncio_connection = **** {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] database.asyncio_slave_connection = **** {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] database.backend = sqlalchemy {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] database.connection = **** {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] database.connection_debug = 0 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] database.connection_parameters = {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] database.connection_recycle_time = 3600 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] database.connection_trace = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] database.db_inc_retry_interval = True {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] database.db_max_retries = 20 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] database.db_max_retry_interval = 10 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] database.db_retry_interval = 1 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] database.max_overflow = 50 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] database.max_pool_size = 5 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] database.max_retries = 10 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] database.mysql_wsrep_sync_wait = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] database.pool_timeout = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] database.retry_interval = 10 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] database.slave_connection = **** {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] database.sqlite_synchronous = True {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] database.synchronous_reader = True {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] database.use_db_reconnect = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] profiler.connection_string = messaging:// {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] profiler.enabled = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] profiler.es_doc_type = notification {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] profiler.es_scroll_size = 10000 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] profiler.es_scroll_time = 2m {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] profiler.filter_error_trace = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] profiler.hmac_keys = **** {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] profiler.sentinel_service_name = mymaster {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] profiler.socket_timeout = 0.1 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] profiler.trace_requests = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] profiler.trace_sqlalchemy = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] profiler_jaeger.process_tags = {} {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] profiler_jaeger.service_name_prefix = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] profiler_otlp.service_name_prefix = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_policy.enforce_new_defaults = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: WARNING oslo_config.cfg [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_policy.enforce_scope = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_policy.policy_default_rule = default {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_policy.policy_file = policy.yaml {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_policy.remote_timeout = 60.0 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] privsep_osbrick.group = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] privsep_osbrick.helper_command = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] privsep_osbrick.user = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cinder_sys_admin.group = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cinder_sys_admin.helper_command = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] cinder_sys_admin.user = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] service_user.auth_section = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] service_user.auth_type = password {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] service_user.cafile = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] service_user.certfile = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] service_user.collect_timing = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:25 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] service_user.insecure = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] service_user.keyfile = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.065s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] service_user.send_service_user_token = True {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] service_user.split_loggers = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] service_user.timeout = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] glance.auth_section = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] glance.auth_type = password {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] glance.certfile = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] glance.collect_timing = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] glance.insecure = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] glance.keyfile = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] glance.region_name = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] glance.split_loggers = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] glance.timeout = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.backend_availability_zone = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.chap_password = **** {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.chap_username = {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.disk_geometry = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.driver_client_cert = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.driver_client_cert_key = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.driver_data_namespace = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.driver_use_ssl = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.enable_unsupported_driver = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.extra_capabilities = {} {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.filter_function = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.goodness_function = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.iscsi_target_flags = {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.iscsi_write_cache = on {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.iser_helper = tgtadm {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.iser_ip_address = 192.168.122.191 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.iser_port = 3260 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.lvm_mirrors = 0 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.lvm_share_target = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.lvm_type = auto {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.num_shell_tries = 3 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.nvmet_port_id = 1 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.replication_device = **** {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.report_discard_supported = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.reserved_percentage = 0 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.scst_target_driver = iscsi {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.scst_target_iqn_name = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.storage_protocol = iSCSI {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.target_helper = tgtadm {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.target_ip_address = 192.168.122.191 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.target_port = 3260 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.target_protocol = iscsi {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.trace_flags = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.unique_fqdn_network = True {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.use_chap_auth = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.volume_backend_name = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.volume_clear = zero {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.volume_clear_ionice = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.volume_clear_size = 0 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.volume_group = cinder-volumes {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_reports.file_event_handler = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_reports.log_dir = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.backend_availability_zone = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.backend_host = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.chap_password = **** {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.chap_username = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.chiscsi_conf = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.disk_geometry = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.driver_client_cert = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.driver_client_cert_key = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.driver_data_namespace = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.driver_use_ssl = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.extra_capabilities = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.filter_function = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.goodness_function = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.iscsi_target_flags = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.iscsi_write_cache = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.iser_helper = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.iser_ip_address = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.iser_port = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.iser_target_prefix = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.lvm_conf_file = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.lvm_mirrors = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.lvm_share_target = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.lvm_type = auto {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.num_shell_tries = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.nvmet_ns_id = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.nvmet_port_id = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.replication_device = **** {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.report_discard_supported = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.reserved_percentage = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.scst_target_driver = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.storage_protocol = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.target_helper = lioadm {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.target_ip_address = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.target_port = 3260 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.target_protocol = iscsi {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.trace_flags = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.unique_fqdn_network = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.use_chap_auth = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.volume_clear = zero {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.volume_clear_ionice = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.volume_clear_size = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] lvmdriver-1.volumes_dir = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.ssl = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.ssl_version = {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_notifications.driver = [] {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_notifications.retry = -1 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] oslo_messaging_notifications.transport_url = **** {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] key_manager.fixed_key = **** {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] barbican.barbican_api_version = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] barbican.barbican_endpoint = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] barbican.barbican_endpoint_type = public {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] barbican.barbican_region_name = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] barbican.cafile = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] barbican.certfile = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] barbican.collect_timing = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] barbican.insecure = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] barbican.keyfile = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] barbican.number_of_retries = 60 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] barbican.retry_delay = 1 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] barbican.send_service_user_token = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack sudo[71943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] barbican.split_loggers = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] barbican.timeout = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] barbican.verify_ssl = True {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] barbican.verify_ssl_path = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack sudo[71943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] barbican_service_user.auth_section = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] barbican_service_user.auth_type = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] barbican_service_user.cafile = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] barbican_service_user.certfile = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] barbican_service_user.collect_timing = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] barbican_service_user.insecure = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] barbican_service_user.keyfile = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] barbican_service_user.split_loggers = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] barbican_service_user.timeout = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] vault.approle_role_id = **** {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] vault.approle_secret_id = **** {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] vault.kv_mountpoint = secret {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] vault.kv_path = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] vault.kv_version = 2 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] vault.namespace = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] vault.root_token_id = **** {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] vault.ssl_ca_crt_file = None {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] vault.timeout = 60.0 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] vault.use_ssl = False {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:42:26 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] ******************************************************************************** {{(pid=71833) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 25 15:42:26 devstack sudo[71943]: pam_unix(sudo:session): session closed for user root Apr 25 15:42:26 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.540s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:42:26 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:42:26 devstack sudo[71948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 25 15:42:26 devstack sudo[71948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:42:27 devstack sudo[71948]: pam_unix(sudo:session): session closed for user root Apr 25 15:42:27 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.488s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:42:27 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 25 15:42:27 devstack cinder-volume[71938]: INFO cinder.brick.local_dev.lvm [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 25 15:42:27 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:42:27 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:42:27 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:42:27 devstack sudo[72174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 25 15:42:27 devstack sudo[72174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:42:27 devstack sudo[72174]: pam_unix(sudo:session): session closed for user root Apr 25 15:42:27 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.580s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:42:27 devstack cinder-volume[71938]: DEBUG cinder.brick.local_dev.lvm [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=71938) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 25 15:42:27 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:42:27 devstack sudo[72373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 25 15:42:27 devstack sudo[72373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:42:28 devstack sudo[72373]: pam_unix(sudo:session): session closed for user root Apr 25 15:42:28 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.265s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:42:28 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:42:28 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:42:28 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:42:29 devstack sudo[72589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 25 15:42:29 devstack sudo[72589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:42:29 devstack sudo[72589]: pam_unix(sudo:session): session closed for user root Apr 25 15:42:29 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.599s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:42:29 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:42:29 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:42:29 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:42:29 devstack sudo[72637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 25 15:42:29 devstack sudo[72637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:42:30 devstack sudo[72637]: pam_unix(sudo:session): session closed for user root Apr 25 15:42:30 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.503s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:42:30 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:42:30 devstack sudo[72641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 25 15:42:30 devstack sudo[72641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:42:30 devstack sudo[72641]: pam_unix(sudo:session): session closed for user root Apr 25 15:42:30 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.530s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:42:30 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:42:30 devstack sudo[72646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 25 15:42:30 devstack sudo[72646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:42:31 devstack sudo[72646]: pam_unix(sudo:session): session closed for user root Apr 25 15:42:31 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.576s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:42:31 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:42:31 devstack sudo[72655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 25 15:42:31 devstack sudo[72655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:42:31 devstack sudo[72655]: pam_unix(sudo:session): session closed for user root Apr 25 15:42:31 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.483s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:42:31 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:42:31 devstack sudo[72658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 25 15:42:31 devstack sudo[72658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:42:32 devstack sudo[72658]: pam_unix(sudo:session): session closed for user root Apr 25 15:42:32 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.562s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:42:32 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:42:32 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:42:32 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:42:32 devstack sudo[72668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 25 15:42:32 devstack sudo[72668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:42:33 devstack sudo[72668]: pam_unix(sudo:session): session closed for user root Apr 25 15:42:33 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.691s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:42:33 devstack cinder-volume[71938]: INFO cinder.volume.drivers.lvm [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 25 15:42:33 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:42:33 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:42:33 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:42:33 devstack sudo[72781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 25 15:42:33 devstack sudo[72781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:42:33 devstack sudo[72781]: pam_unix(sudo:session): session closed for user root Apr 25 15:42:33 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.525s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:42:33 devstack cinder-volume[71938]: DEBUG cinder.volume.drivers.lvm [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Updating volume stats {{(pid=71938) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 25 15:42:33 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:42:33 devstack sudo[72828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 25 15:42:33 devstack sudo[72828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:42:34 devstack sudo[72828]: pam_unix(sudo:session): session closed for user root Apr 25 15:42:34 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.463s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:42:34 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:42:34 devstack sudo[72927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 25 15:42:34 devstack sudo[72927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:42:34 devstack sudo[72927]: pam_unix(sudo:session): session closed for user root Apr 25 15:42:34 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.490s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:42:34 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:42:34 devstack sudo[72932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 25 15:42:34 devstack sudo[72932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:42:34 devstack sudo[72932]: pam_unix(sudo:session): session closed for user root Apr 25 15:42:34 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.454s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:42:34 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:42:35 devstack sudo[72935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 25 15:42:35 devstack sudo[72935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:42:35 devstack sudo[72935]: pam_unix(sudo:session): session closed for user root Apr 25 15:42:35 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.500s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:42:35 devstack cinder-volume[71938]: INFO cinder.volume.driver [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Driver hasn't implemented _init_vendor_properties() Apr 25 15:42:35 devstack cinder-volume[71938]: DEBUG cinder.volume.driver [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=71938) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 25 15:42:35 devstack cinder-volume[71938]: DEBUG oslo_db.sqlalchemy.engines [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=71938) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 25 15:42:35 devstack cinder-volume[71938]: DEBUG dbcounter [-] [71938] Writer thread running {{(pid=71938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 25 15:42:35 devstack cinder-volume[71938]: DEBUG cinder.db.sqlalchemy.api [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Building query based on filter {{(pid=71938) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 25 15:42:35 devstack cinder-volume[71938]: DEBUG cinder.image.image_utils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=71938) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 25 15:42:35 devstack cinder-volume[71938]: INFO cinder.keymgr.migration [None req-68833fd8-d8c3-4f3c-9313-c6480951e03b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 25 15:42:35 devstack cinder-volume[71938]: DEBUG cinder.volume.drivers.lvm [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Updating volume stats {{(pid=71938) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 25 15:42:35 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:42:35 devstack sudo[72943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 25 15:42:35 devstack sudo[72943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:42:35 devstack cinder-volume[71833]: DEBUG dbcounter [-] [71833] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=71833) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:42:36 devstack sudo[72943]: pam_unix(sudo:session): session closed for user root Apr 25 15:42:36 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.506s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:42:36 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:42:36 devstack sudo[72947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 25 15:42:36 devstack sudo[72947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:42:36 devstack sudo[72947]: pam_unix(sudo:session): session closed for user root Apr 25 15:42:36 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.531s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:42:36 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:42:36 devstack sudo[72952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 25 15:42:36 devstack sudo[72952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:42:37 devstack sudo[72952]: pam_unix(sudo:session): session closed for user root Apr 25 15:42:37 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.528s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:42:37 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:42:37 devstack sudo[72955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 25 15:42:37 devstack sudo[72955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:42:37 devstack sudo[72955]: pam_unix(sudo:session): session closed for user root Apr 25 15:42:37 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.533s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:42:37 devstack cinder-volume[71938]: DEBUG cinder.manager [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Notifying Schedulers of capabilities ... {{(pid=71938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:42:37 devstack cinder-volume[71938]: INFO cinder.volume.manager [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Driver initialization completed successfully. Apr 25 15:42:37 devstack cinder-volume[71938]: INFO cinder.manager [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Initiating service 2 cleanup Apr 25 15:42:37 devstack cinder-volume[71938]: INFO cinder.manager [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Service 2 cleanup completed. Apr 25 15:42:37 devstack cinder-volume[71938]: DEBUG cinder.service [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Creating RPC server for service cinder-volume {{(pid=71938) start /opt/stack/cinder/cinder/service.py:231}} Apr 25 15:42:37 devstack cinder-volume[71938]: DEBUG cinder.service [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=71938) start /opt/stack/cinder/cinder/service.py:237}} Apr 25 15:42:37 devstack cinder-volume[71938]: INFO cinder.volume.manager [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 25 15:42:37 devstack cinder-volume[71938]: DEBUG cinder.volume.drivers.lvm [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Updating volume stats {{(pid=71938) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 25 15:42:37 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:42:37 devstack sudo[72962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 25 15:42:37 devstack sudo[72962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:42:38 devstack sudo[72962]: pam_unix(sudo:session): session closed for user root Apr 25 15:42:38 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.587s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:42:38 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:42:38 devstack sudo[72965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 25 15:42:38 devstack sudo[72965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:42:38 devstack sudo[72965]: pam_unix(sudo:session): session closed for user root Apr 25 15:42:38 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:42:38 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:42:38 devstack sudo[73004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 25 15:42:38 devstack sudo[73004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:42:39 devstack sudo[73004]: pam_unix(sudo:session): session closed for user root Apr 25 15:42:39 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.519s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:42:39 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:42:39 devstack sudo[73025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 25 15:42:39 devstack sudo[73025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:42:39 devstack sudo[73025]: pam_unix(sudo:session): session closed for user root Apr 25 15:42:39 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:42:39 devstack cinder-volume[71938]: INFO cinder.volume.manager [None req-69c75155-57b3-4d2b-ae1a-517a35c8eecd None None] Driver post RPC initialization completed successfully. Apr 25 15:42:49 devstack cinder-volume[71938]: DEBUG dbcounter [-] [71938] Writing DB stats cinder:SELECT=5 {{(pid=71938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:42:49 devstack cinder-volume[71938]: DEBUG dbcounter [-] [71938] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=71938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:44:11 devstack cinder-volume[71938]: DEBUG oslo_service.periodic_task [None req-83e446f1-9f70-4a64-a338-c993dc64bb35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=71938) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 25 15:44:11 devstack cinder-volume[71938]: DEBUG cinder.volume.drivers.lvm [None req-83e446f1-9f70-4a64-a338-c993dc64bb35 None None] Updating volume stats {{(pid=71938) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 25 15:44:11 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-83e446f1-9f70-4a64-a338-c993dc64bb35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:44:11 devstack sudo[78040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 25 15:44:11 devstack sudo[78040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:44:12 devstack sudo[78040]: pam_unix(sudo:session): session closed for user root Apr 25 15:44:12 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-83e446f1-9f70-4a64-a338-c993dc64bb35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:44:12 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-83e446f1-9f70-4a64-a338-c993dc64bb35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:44:12 devstack sudo[78043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 25 15:44:12 devstack sudo[78043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:44:12 devstack sudo[78043]: pam_unix(sudo:session): session closed for user root Apr 25 15:44:12 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-83e446f1-9f70-4a64-a338-c993dc64bb35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.457s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:44:12 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-83e446f1-9f70-4a64-a338-c993dc64bb35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:44:12 devstack sudo[78046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 25 15:44:12 devstack sudo[78046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:44:13 devstack sudo[78046]: pam_unix(sudo:session): session closed for user root Apr 25 15:44:13 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-83e446f1-9f70-4a64-a338-c993dc64bb35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.453s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:44:13 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-83e446f1-9f70-4a64-a338-c993dc64bb35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:44:13 devstack sudo[78049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 25 15:44:13 devstack sudo[78049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:44:13 devstack sudo[78049]: pam_unix(sudo:session): session closed for user root Apr 25 15:44:13 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-83e446f1-9f70-4a64-a338-c993dc64bb35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:44:13 devstack cinder-volume[71938]: DEBUG cinder.manager [None req-83e446f1-9f70-4a64-a338-c993dc64bb35 None None] Notifying Schedulers of capabilities ... {{(pid=71938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:44:49 devstack cinder-volume[71938]: DEBUG dbcounter [-] [71938] Writing DB stats cinder:SELECT=1 {{(pid=71938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:44:49 devstack cinder-volume[71938]: DEBUG dbcounter [-] [71938] Writing DB stats cinder:UPDATE=1 {{(pid=71938) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:45:11 devstack cinder-volume[71938]: DEBUG oslo_service.periodic_task [None req-83e446f1-9f70-4a64-a338-c993dc64bb35 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=71938) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 25 15:45:11 devstack cinder-volume[71938]: DEBUG cinder.volume.drivers.lvm [None req-83e446f1-9f70-4a64-a338-c993dc64bb35 None None] Updating volume stats {{(pid=71938) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 25 15:45:11 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-83e446f1-9f70-4a64-a338-c993dc64bb35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:45:11 devstack sudo[79888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 25 15:45:11 devstack sudo[79888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:45:12 devstack sudo[79888]: pam_unix(sudo:session): session closed for user root Apr 25 15:45:12 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-83e446f1-9f70-4a64-a338-c993dc64bb35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.449s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:45:12 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-83e446f1-9f70-4a64-a338-c993dc64bb35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:45:12 devstack sudo[79892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 25 15:45:12 devstack sudo[79892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:45:12 devstack sudo[79892]: pam_unix(sudo:session): session closed for user root Apr 25 15:45:12 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-83e446f1-9f70-4a64-a338-c993dc64bb35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:45:12 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-83e446f1-9f70-4a64-a338-c993dc64bb35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:45:12 devstack sudo[79895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 25 15:45:12 devstack sudo[79895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:45:13 devstack sudo[79895]: pam_unix(sudo:session): session closed for user root Apr 25 15:45:13 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-83e446f1-9f70-4a64-a338-c993dc64bb35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.439s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:45:13 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-83e446f1-9f70-4a64-a338-c993dc64bb35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:45:13 devstack sudo[79909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 25 15:45:13 devstack sudo[79909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:45:13 devstack sudo[79909]: pam_unix(sudo:session): session closed for user root Apr 25 15:45:13 devstack cinder-volume[71938]: DEBUG oslo_concurrency.processutils [None req-83e446f1-9f70-4a64-a338-c993dc64bb35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=71938) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:45:13 devstack cinder-volume[71938]: DEBUG cinder.manager [None req-83e446f1-9f70-4a64-a338-c993dc64bb35 None None] Notifying Schedulers of capabilities ... {{(pid=71938) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:46:01 devstack cinder-volume[71833]: INFO oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] Caught SIGTERM, stopping children Apr 25 15:46:01 devstack cinder-volume[71833]: DEBUG oslo_concurrency.lockutils [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] Acquiring lock "singleton_lock" {{(pid=71833) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 25 15:46:01 devstack cinder-volume[71833]: DEBUG oslo_concurrency.lockutils [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] Acquired lock "singleton_lock" {{(pid=71833) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 25 15:46:01 devstack cinder-volume[71833]: DEBUG oslo_concurrency.lockutils [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] Releasing lock "singleton_lock" {{(pid=71833) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 25 15:46:01 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] Stop services. {{(pid=71833) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 25 15:46:01 devstack cinder-volume[71833]: DEBUG oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] Killing children. {{(pid=71833) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 25 15:46:01 devstack cinder-volume[71833]: INFO oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] Waiting on 1 children to exit Apr 25 15:46:02 devstack cinder-volume[71938]: DEBUG oslo_concurrency.lockutils [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] Acquiring lock "singleton_lock" {{(pid=71938) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 25 15:46:02 devstack cinder-volume[71938]: DEBUG oslo_concurrency.lockutils [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] Acquired lock "singleton_lock" {{(pid=71938) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 25 15:46:02 devstack cinder-volume[71938]: DEBUG oslo_concurrency.lockutils [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] Releasing lock "singleton_lock" {{(pid=71938) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 25 15:46:02 devstack cinder-volume[71938]: WARNING amqp [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 25 15:46:02 devstack cinder-volume[71938]: WARNING amqp [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 25 15:46:02 devstack cinder-volume[71833]: INFO oslo_service.backend._eventlet.service [None req-30ebc2f3-a130-4dbc-8b83-4804c1b9d86a None None] Child 71938 exited with status 0 Apr 25 15:46:03 devstack cinder-volume[80865]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 25 15:46:03 devstack cinder-volume[80865]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 25 15:46:03 devstack cinder-volume[80865]: we strongly recommend against using it for new projects. Apr 25 15:46:03 devstack cinder-volume[80865]: If you are already using Eventlet, we recommend migrating to a different Apr 25 15:46:03 devstack cinder-volume[80865]: framework. For more detail see Apr 25 15:46:03 devstack cinder-volume[80865]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 25 15:46:03 devstack cinder-volume[80865]: import eventlet # noqa Apr 25 15:46:05 devstack cinder-volume[80865]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=80865) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 25 15:46:05 devstack cinder-volume[80865]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=80865) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 25 15:46:05 devstack cinder-volume[80865]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=80865) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 25 15:46:05 devstack cinder-volume[80865]: INFO dbcounter [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] Registered counter for database cinder Apr 25 15:46:05 devstack cinder-volume[80865]: DEBUG oslo_db.sqlalchemy.engines [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80865) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 25 15:46:05 devstack cinder-volume[80865]: DEBUG dbcounter [-] [80865] Writer thread running {{(pid=80865) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 25 15:46:05 devstack cinder-volume[80865]: INFO cinder.rpc [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 25 15:46:05 devstack cinder-volume[80865]: INFO cinder.rpc [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 25 15:46:05 devstack cinder-volume[80865]: DEBUG oslo_db.sqlalchemy.engines [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80865) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 25 15:46:05 devstack cinder-volume[80865]: INFO cinder.volume.manager [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] Determined volume DB was empty at startup. Apr 25 15:46:05 devstack cinder-volume[80865]: DEBUG cinder.volume.manager [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=80865) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 25 15:46:06 devstack cinder-volume[80865]: INFO cinder.volume.manager [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 25 15:46:06 devstack cinder-volume[80865]: WARNING stevedore.named [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 25 15:46:06 devstack cinder-volume[80865]: WARNING castellan.key_manager [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 25 15:46:06 devstack cinder-volume[80865]: WARNING cinder.keymgr.conf_key_mgr [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 25 15:46:06 devstack cinder-volume[80865]: INFO cinder.volume.manager [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_db.sqlalchemy.engines [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80865) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 25 15:46:06 devstack cinder-volume[80865]: INFO oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] Starting 1 workers Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] Started child 80985 {{(pid=80865) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] Full set of CONF: {{(pid=80865) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] ******************************************************************************** {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] Configuration options gathered from: {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] ================================================================================ {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] allow_availability_zone_fallback = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] allow_compression_on_image_upload = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80985]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] allowed_direct_url_schemes = [] {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] api_rate_limit = True {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] auth_strategy = keystone {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_availability_zone = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_host = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_name = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_stats_polling_interval = 60 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backup_api_class = cinder.backup.api.API {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backup_name_template = backup-%s {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backup_use_same_host = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backup_use_temp_snapshot = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] chap_password = **** {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] chap_username = {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cinder_internal_tenant_project_id = 79df31b9be6c4bb4bea87087bba0cfd8 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cinder_internal_tenant_user_id = 2396e662689842b09266fbeda548f62a {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cluster = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] compression_format = gzip {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] compute_api_class = cinder.compute.nova.API {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] config_dir = [] {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] config_source = [] {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] control_exchange = openstack {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] debug = True {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] default_availability_zone = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] default_group_type = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] default_volume_type = QuobyteHD {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] disk_geometry = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] driver_client_cert = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] driver_client_cert_key = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] driver_data_namespace = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] driver_ssl_cert_path = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] driver_ssl_cert_verify = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] driver_use_ssl = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] enable_new_services = True {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] enable_unsupported_driver = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] enabled_backends = ['QuobyteHD'] {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80985]: INFO cinder.volume.manager [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 25 15:46:06 devstack cinder-volume[80985]: DEBUG cinder.volume.drivers.remotefs [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=80985) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] enforce_multipath_for_image_xfer = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] filter_function = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] glance_api_insecure = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] glance_api_servers = ['http://192.168.122.191/image'] {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] glance_api_ssl_compression = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] glance_ca_certificates_file = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] glance_catalog_info = image:glance:publicURL {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] glance_certfile = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] glance_keyfile = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] glance_num_retries = 3 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] glance_request_timeout = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] goodness_function = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] graceful_shutdown_timeout = 5 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] group_api_class = cinder.group.api.API {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] host = devstack {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] image_compress_on_upload = True {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] image_conversion_address_space_limit = 1 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] image_conversion_cpu_limit = 60 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] image_conversion_disable = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] image_upload_use_cinder_backend = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] image_upload_use_internal_tenant = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] image_volume_cache_enabled = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] image_volume_cache_max_count = 0 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] image_volume_cache_max_size_gb = 0 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] init_host_max_objects_retrieval = 0 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] instance_format = [instance: %(uuid)s] {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] iscsi_target_flags = {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] iscsi_write_cache = on {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] iser_helper = tgtadm {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] iser_ip_address = 192.168.122.191 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] iser_port = 3260 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] log_color = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] log_config_append = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] log_dir = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] log_file = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] log_options = True {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] log_rotate_interval = 1 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] log_rotate_interval_type = days {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] log_rotation_type = none {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] max_age = 0 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] max_logfile_count = 30 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] max_logfile_size_mb = 200 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] max_over_subscription_ratio = 20.0 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] message_reap_interval = 86400 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] message_ttl = 2592000 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] migration_create_volume_timeout_secs = 300 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] monkey_patch = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] monkey_patch_modules = [] {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] my_ip = 192.168.122.191 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] no_snapshot_gb_quota = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] num_iser_scan_tries = 3 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] num_shell_tries = 3 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] num_volume_device_scan_tries = 3 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] nvmeof_conn_info_version = 1 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] nvmet_ns_id = 10 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] nvmet_port_id = 1 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] osapi_max_limit = 1000 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] osapi_volume_ext_list = [] {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] osapi_volume_listen = 0.0.0.0 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] osapi_volume_listen_port = 8776 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] osapi_volume_use_ssl = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] osapi_volume_workers = 2 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] per_volume_size_limit = -1 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] periodic_fuzzy_delay = 60 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] periodic_interval = 60 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] project_id_regex = [0-9a-f\-]+ {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] public_endpoint = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80985]: DEBUG cinder.volume.drivers.quobyte [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=80985) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 25 15:46:06 devstack cinder-volume[80985]: WARNING cinder.volume.drivers.quobyte [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 25 15:46:06 devstack cinder-volume[80985]: WARNING cinder.volume.drivers.quobyte [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] publish_errors = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] quota_backup_gigabytes = 1000 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80985]: DEBUG oslo_concurrency.processutils [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Running cmd (subprocess): mount.quobyte {{(pid=80985) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] quota_backups = 10 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] quota_gigabytes = 1000 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] quota_groups = 10 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] quota_snapshots = 10 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] quota_volumes = 10 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] rate_limit_burst = 0 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] rate_limit_except_level = CRITICAL {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] rate_limit_interval = 0 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] reinit_driver_count = 3 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] replication_device = **** {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] report_discard_supported = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] report_interval = 120 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] reservation_clean_interval = 86400 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] reservation_expire = 86400 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] reserved_image_namespaces = [] {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] reserved_percentage = 0 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] rpc_response_timeout = 120 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] run_external_periodic_tasks = True {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] scst_target_driver = iscsi {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] scst_target_iqn_name = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] service_down_time = 720 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] shell_completion = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] snapshot_name_template = snapshot-%s {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] split_loggers = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] state_path = /opt/stack/data/cinder {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] storage_availability_zone = nova {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] storage_protocol = iSCSI {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] syslog_log_facility = LOG_USER {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] target_helper = lioadm {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] target_ip_address = 192.168.122.191 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] target_port = 3260 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] target_protocol = iscsi {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] target_secondary_ip_addresses = [] {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] trace_flags = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] transfer_api_class = cinder.transfer.api.API {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] transport_url = **** {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] until_refresh = 0 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] use_chap_auth = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] use_default_quota_class = True {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] use_journal = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] use_json = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] use_multipath_for_image_xfer = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] use_stderr = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] use_syslog = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] verify_glance_signatures = enabled {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] volume_api_class = cinder.volume.api.API {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] volume_backend_name = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] volume_clear = zero {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] volume_clear_ionice = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] volume_clear_size = 0 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] volume_copy_bps_limit = 0 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] volume_dd_blocksize = 1M {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] volume_name_template = volume-%s {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] volume_service_inithost_offload = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] volume_usage_audit_period = month {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] zoning_mode = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_concurrency.disable_process_locking = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.admin_password = **** {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.admin_token = **** {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.admin_user = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.auth_admin_prefix = {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.auth_port = 35357 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.auth_protocol = https {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.auth_section = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.auth_type = password {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.auth_uri = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.auth_version = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.cache = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.certfile = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.delay_auth_decision = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.http_connect_timeout = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.identity_uri = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.include_service_catalog = True {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.insecure = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.interface = public {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.keyfile = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.memcache_password = {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.memcache_username = {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack quobyte-client[80986]: Reading configuration file: /etc/quobyte/client.cfg Apr 25 15:46:06 devstack quobyte-client[80986]: Invalid parameters found, error: missing mount point. Apr 25 15:46:06 devstack quobyte-client[80986]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 25 15:46:06 devstack quobyte-client[80986]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.region_name = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.service_token_roles_required = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.service_type = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.token_cache_time = 300 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.191/identity {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.backend = dogpile.cache.null {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.backend_argument = **** {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.backend_expiration_time = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.config_prefix = cache.oslo {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.debug_cache_backend = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.enable_retry_client = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.enable_socket_keepalive = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.enabled = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.enforce_fips_mode = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.expiration_time = 600 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.hashclient_retry_attempts = 2 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80985]: DEBUG oslo_concurrency.processutils [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] CMD "mount.quobyte" returned: 1 in 0.096s {{(pid=80985) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80985]: DEBUG oslo_concurrency.lockutils [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80985) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:46:06 devstack cinder-volume[80985]: DEBUG oslo_concurrency.lockutils [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80985) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:46:06 devstack cinder-volume[80985]: DEBUG cinder.volume.drivers.quobyte [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=80985) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.memcache_dead_retry = 300 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80985]: INFO cinder.volume.drivers.quobyte [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf ... Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80985]: DEBUG oslo_concurrency.processutils [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 -c /etc/quobyte/client-cinder.cfg {{(pid=80985) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.memcache_pool_maxsize = 10 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.memcache_sasl_enabled = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.password = **** {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.proxies = [] {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.redis_db = 0 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.redis_sentinel_service_name = mymaster {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.redis_server = localhost:6379 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.retry_attempts = 2 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.retry_delay = 0.0 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.socket_keepalive_count = 1 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.socket_keepalive_idle = 1 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.socket_keepalive_interval = 1 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.socket_timeout = 1.0 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.tls_allowed_ciphers = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.tls_cafile = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.tls_certfile = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.tls_enabled = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.tls_keyfile = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cache.username = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] coordination.backend_url = **** {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] database.asyncio_connection = **** {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] database.asyncio_slave_connection = **** {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack sudo[80987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 -c /etc/quobyte/client-cinder.cfg Apr 25 15:46:06 devstack sudo[80987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] database.backend = sqlalchemy {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] database.connection = **** {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] database.connection_debug = 0 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] database.connection_parameters = {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] database.connection_recycle_time = 3600 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] database.connection_trace = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] database.db_inc_retry_interval = True {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] database.db_max_retries = 20 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] database.db_max_retry_interval = 10 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] database.db_retry_interval = 1 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] database.max_overflow = 50 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] database.max_pool_size = 5 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] database.max_retries = 10 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] database.mysql_wsrep_sync_wait = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] database.pool_timeout = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] database.retry_interval = 10 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] database.slave_connection = **** {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] database.sqlite_synchronous = True {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] database.synchronous_reader = True {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] database.use_db_reconnect = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] profiler.connection_string = messaging:// {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] profiler.enabled = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] profiler.es_doc_type = notification {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] profiler.es_scroll_size = 10000 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] profiler.es_scroll_time = 2m {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] profiler.filter_error_trace = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] profiler.hmac_keys = **** {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] profiler.sentinel_service_name = mymaster {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] profiler.socket_timeout = 0.1 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] profiler.trace_requests = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] profiler.trace_sqlalchemy = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] profiler_jaeger.process_tags = {} {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] profiler_jaeger.service_name_prefix = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] profiler_otlp.service_name_prefix = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_policy.enforce_new_defaults = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: WARNING oslo_config.cfg [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_policy.enforce_scope = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_policy.policy_default_rule = default {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_policy.policy_file = policy.yaml {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_policy.remote_timeout = 60.0 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] privsep_osbrick.group = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] privsep_osbrick.helper_command = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] privsep_osbrick.user = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cinder_sys_admin.group = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cinder_sys_admin.helper_command = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] cinder_sys_admin.user = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] service_user.auth_section = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] service_user.auth_type = password {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] service_user.cafile = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] service_user.certfile = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] service_user.collect_timing = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] service_user.insecure = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] service_user.keyfile = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] service_user.send_service_user_token = True {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] service_user.split_loggers = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] service_user.timeout = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] glance.auth_section = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] glance.auth_type = password {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] glance.certfile = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] glance.collect_timing = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] glance.insecure = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] glance.keyfile = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] glance.region_name = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] glance.split_loggers = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] glance.timeout = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.backend_availability_zone = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.chap_password = **** {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.chap_username = {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.disk_geometry = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.driver_client_cert = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.driver_client_cert_key = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.driver_data_namespace = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.driver_use_ssl = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.enable_unsupported_driver = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.extra_capabilities = {} {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.filter_function = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.goodness_function = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.iscsi_target_flags = {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.iscsi_write_cache = on {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.iser_helper = tgtadm {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.iser_ip_address = 192.168.122.191 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.iser_port = 3260 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.nas_host = {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.nas_login = admin {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.nas_mount_options = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.nas_password = **** {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.nas_private_key = {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.nas_share_path = {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.nas_ssh_port = 22 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.num_shell_tries = 3 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.nvmet_port_id = 1 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.quobyte_client_cfg = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.quobyte_volume_url = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.replication_device = **** {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.report_discard_supported = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.reserved_percentage = 0 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.scst_target_driver = iscsi {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.scst_target_iqn_name = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.storage_protocol = iSCSI {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.target_helper = tgtadm {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.target_ip_address = 192.168.122.191 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.target_port = 3260 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.target_protocol = iscsi {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.trace_flags = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.unique_fqdn_network = True {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.use_chap_auth = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.volume_backend_name = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.volume_clear = zero {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.volume_clear_ionice = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.volume_clear_size = 0 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_reports.file_event_handler = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_reports.log_dir = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.backend_availability_zone = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.backend_host = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.chap_password = **** {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.chap_username = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.chiscsi_conf = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.disk_geometry = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.driver_client_cert = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.driver_client_cert_key = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.driver_data_namespace = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.driver_use_ssl = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.extra_capabilities = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.filter_function = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.goodness_function = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.iscsi_target_flags = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.iscsi_write_cache = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.iser_helper = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.iser_ip_address = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.iser_port = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.iser_target_prefix = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.nas_host = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.nas_login = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.nas_mount_options = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.nas_password = **** {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.nas_private_key = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.nas_share_path = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.nas_ssh_port = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.num_shell_tries = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.nvmet_ns_id = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.nvmet_port_id = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.replication_device = **** {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.report_discard_supported = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.reserved_percentage = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.scst_target_driver = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.storage_protocol = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.target_helper = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.target_ip_address = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.target_port = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.target_prefix = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.target_protocol = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.trace_flags = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.unique_fqdn_network = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.use_chap_auth = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.volume_clear = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.volume_clear_ionice = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.volume_clear_size = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] QuobyteHD.volumes_dir = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.ssl = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.ssl_version = {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_notifications.driver = [] {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_notifications.retry = -1 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] oslo_messaging_notifications.transport_url = **** {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] key_manager.fixed_key = **** {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] barbican.barbican_api_version = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] barbican.barbican_endpoint = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] barbican.barbican_endpoint_type = public {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] barbican.barbican_region_name = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] barbican.cafile = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] barbican.certfile = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] barbican.collect_timing = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] barbican.insecure = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] barbican.keyfile = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] barbican.number_of_retries = 60 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] barbican.retry_delay = 1 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] barbican.send_service_user_token = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] barbican.split_loggers = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] barbican.timeout = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] barbican.verify_ssl = True {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] barbican.verify_ssl_path = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] barbican_service_user.auth_section = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] barbican_service_user.auth_type = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] barbican_service_user.cafile = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] barbican_service_user.certfile = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] barbican_service_user.collect_timing = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] barbican_service_user.insecure = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] barbican_service_user.keyfile = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] barbican_service_user.split_loggers = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] barbican_service_user.timeout = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] vault.approle_role_id = **** {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] vault.approle_secret_id = **** {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] vault.kv_mountpoint = secret {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] vault.kv_path = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] vault.kv_version = 2 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] vault.namespace = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] vault.root_token_id = **** {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] vault.ssl_ca_crt_file = None {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] vault.timeout = 60.0 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] vault.use_ssl = False {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:06 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] ******************************************************************************** {{(pid=80865) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 25 15:46:06 devstack sudo[80987]: pam_unix(sudo:session): session closed for user root Apr 25 15:46:06 devstack cinder-volume[80985]: DEBUG oslo_concurrency.processutils [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.554s {{(pid=80985) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:46:06 devstack cinder-volume[80985]: INFO cinder.volume.drivers.quobyte [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf succeeded Apr 25 15:46:06 devstack cinder-volume[80985]: DEBUG cinder.volume.drivers.quobyte [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=80985) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:46:06 devstack cinder-volume[80985]: DEBUG oslo_concurrency.lockutils [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.562s {{(pid=80985) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:46:06 devstack cinder-volume[80985]: DEBUG oslo_concurrency.processutils [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=80985) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:46:06 devstack sudo[81056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:46:06 devstack sudo[81056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:46:07 devstack sudo[81056]: pam_unix(sudo:session): session closed for user root Apr 25 15:46:07 devstack cinder-volume[80985]: DEBUG oslo_concurrency.processutils [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.401s {{(pid=80985) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:46:07 devstack cinder-volume[80985]: INFO cinder.volume.driver [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Driver hasn't implemented _init_vendor_properties() Apr 25 15:46:07 devstack cinder-volume[80985]: DEBUG cinder.volume.driver [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7188148498535, 'free_capacity_gb': 1775.7188148498535, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=80985) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 25 15:46:07 devstack cinder-volume[80985]: DEBUG oslo_db.sqlalchemy.engines [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80985) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 25 15:46:07 devstack cinder-volume[80985]: DEBUG dbcounter [-] [80985] Writer thread running {{(pid=80985) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 25 15:46:07 devstack cinder-volume[80985]: DEBUG cinder.db.sqlalchemy.api [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Building query based on filter {{(pid=80985) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 25 15:46:07 devstack cinder-volume[80985]: DEBUG cinder.image.image_utils [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=80985) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 25 15:46:07 devstack cinder-volume[80985]: INFO cinder.keymgr.migration [None req-c3797783-815e-41e1-ac9a-56e98aadb717 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 25 15:46:07 devstack cinder-volume[80985]: DEBUG oslo_concurrency.lockutils [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80985) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:46:07 devstack cinder-volume[80985]: DEBUG oslo_concurrency.lockutils [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80985) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:46:07 devstack cinder-volume[80985]: DEBUG cinder.volume.drivers.quobyte [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=80985) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:46:07 devstack cinder-volume[80985]: DEBUG cinder.volume.drivers.quobyte [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=80985) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:46:07 devstack cinder-volume[80985]: DEBUG oslo_concurrency.lockutils [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=80985) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:46:07 devstack cinder-volume[80985]: DEBUG oslo_concurrency.processutils [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=80985) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:46:07 devstack sudo[81093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:46:07 devstack sudo[81093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:46:07 devstack sudo[81093]: pam_unix(sudo:session): session closed for user root Apr 25 15:46:07 devstack cinder-volume[80985]: DEBUG oslo_concurrency.processutils [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.412s {{(pid=80985) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:46:07 devstack cinder-volume[80985]: DEBUG cinder.manager [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Notifying Schedulers of capabilities ... {{(pid=80985) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:46:07 devstack cinder-volume[80985]: INFO cinder.volume.manager [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Driver initialization completed successfully. Apr 25 15:46:07 devstack cinder-volume[80985]: INFO cinder.manager [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Initiating service 3 cleanup Apr 25 15:46:07 devstack cinder-volume[80985]: INFO cinder.manager [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Service 3 cleanup completed. Apr 25 15:46:07 devstack cinder-volume[80985]: DEBUG cinder.service [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Creating RPC server for service cinder-volume {{(pid=80985) start /opt/stack/cinder/cinder/service.py:231}} Apr 25 15:46:07 devstack cinder-volume[80985]: DEBUG cinder.service [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=80985) start /opt/stack/cinder/cinder/service.py:237}} Apr 25 15:46:07 devstack cinder-volume[80985]: INFO cinder.volume.manager [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 25 15:46:07 devstack cinder-volume[80985]: DEBUG oslo_concurrency.lockutils [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80985) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:46:07 devstack cinder-volume[80985]: DEBUG oslo_concurrency.lockutils [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80985) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:46:07 devstack cinder-volume[80985]: DEBUG cinder.volume.drivers.quobyte [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=80985) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:46:07 devstack cinder-volume[80985]: DEBUG cinder.volume.drivers.quobyte [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=80985) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:46:07 devstack cinder-volume[80985]: DEBUG oslo_concurrency.lockutils [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=80985) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:46:07 devstack cinder-volume[80985]: DEBUG oslo_concurrency.processutils [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=80985) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:46:07 devstack sudo[81099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:46:07 devstack sudo[81099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:46:08 devstack sudo[81099]: pam_unix(sudo:session): session closed for user root Apr 25 15:46:08 devstack cinder-volume[80985]: DEBUG oslo_concurrency.processutils [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.423s {{(pid=80985) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:46:08 devstack cinder-volume[80985]: INFO cinder.volume.manager [None req-1ded6bfe-5637-499d-a364-4bcfcb34e0f5 None None] Driver post RPC initialization completed successfully. Apr 25 15:46:11 devstack cinder-volume[80985]: DEBUG oslo_concurrency.lockutils [None req-d0e8c9b0-d803-458d-8e95-22f3ccb28c99 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=80985) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:46:11 devstack cinder-volume[80985]: DEBUG oslo_concurrency.lockutils [None req-d0e8c9b0-d803-458d-8e95-22f3ccb28c99 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=80985) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:46:11 devstack cinder-volume[80985]: DEBUG cinder.volume.drivers.quobyte [None req-d0e8c9b0-d803-458d-8e95-22f3ccb28c99 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=80985) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:46:11 devstack cinder-volume[80985]: DEBUG cinder.volume.drivers.quobyte [None req-d0e8c9b0-d803-458d-8e95-22f3ccb28c99 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=80985) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:46:11 devstack cinder-volume[80985]: DEBUG oslo_concurrency.lockutils [None req-d0e8c9b0-d803-458d-8e95-22f3ccb28c99 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=80985) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:46:11 devstack cinder-volume[80985]: DEBUG oslo_concurrency.processutils [None req-d0e8c9b0-d803-458d-8e95-22f3ccb28c99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=80985) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:46:11 devstack sudo[81603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:46:11 devstack sudo[81603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:46:12 devstack sudo[81603]: pam_unix(sudo:session): session closed for user root Apr 25 15:46:12 devstack cinder-volume[80985]: DEBUG oslo_concurrency.processutils [None req-d0e8c9b0-d803-458d-8e95-22f3ccb28c99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.424s {{(pid=80985) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:46:12 devstack cinder-volume[80985]: DEBUG cinder.manager [None req-d0e8c9b0-d803-458d-8e95-22f3ccb28c99 None None] Notifying Schedulers of capabilities ... {{(pid=80985) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:46:15 devstack cinder-volume[80865]: INFO oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] Caught SIGTERM, stopping children Apr 25 15:46:15 devstack cinder-volume[80865]: DEBUG oslo_concurrency.lockutils [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] Acquiring lock "singleton_lock" {{(pid=80865) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 25 15:46:15 devstack cinder-volume[80865]: DEBUG oslo_concurrency.lockutils [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] Acquired lock "singleton_lock" {{(pid=80865) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 25 15:46:15 devstack cinder-volume[80865]: DEBUG oslo_concurrency.lockutils [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] Releasing lock "singleton_lock" {{(pid=80865) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 25 15:46:15 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] Stop services. {{(pid=80865) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 25 15:46:15 devstack cinder-volume[80865]: DEBUG oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] Killing children. {{(pid=80865) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 25 15:46:15 devstack cinder-volume[80865]: INFO oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] Waiting on 1 children to exit Apr 25 15:46:16 devstack cinder-volume[80985]: DEBUG oslo_concurrency.lockutils [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] Acquiring lock "singleton_lock" {{(pid=80985) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 25 15:46:16 devstack cinder-volume[80985]: DEBUG oslo_concurrency.lockutils [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] Acquired lock "singleton_lock" {{(pid=80985) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 25 15:46:16 devstack cinder-volume[80985]: DEBUG oslo_concurrency.lockutils [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] Releasing lock "singleton_lock" {{(pid=80985) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 25 15:46:16 devstack cinder-volume[80985]: WARNING amqp [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 25 15:46:16 devstack cinder-volume[80985]: WARNING amqp [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 25 15:46:16 devstack cinder-volume[80865]: INFO oslo_service.backend._eventlet.service [None req-d7e4a9e9-1a43-44d6-9f80-e92478a8be14 None None] Child 80985 exited with status 0 Apr 25 15:46:16 devstack cinder-volume[81689]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 25 15:46:16 devstack cinder-volume[81689]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 25 15:46:16 devstack cinder-volume[81689]: we strongly recommend against using it for new projects. Apr 25 15:46:16 devstack cinder-volume[81689]: If you are already using Eventlet, we recommend migrating to a different Apr 25 15:46:16 devstack cinder-volume[81689]: framework. For more detail see Apr 25 15:46:16 devstack cinder-volume[81689]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 25 15:46:16 devstack cinder-volume[81689]: import eventlet # noqa Apr 25 15:46:18 devstack cinder-volume[81689]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81689) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 25 15:46:18 devstack cinder-volume[81689]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81689) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 25 15:46:18 devstack cinder-volume[81689]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81689) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 25 15:46:19 devstack cinder-volume[81689]: INFO dbcounter [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] Registered counter for database cinder Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_db.sqlalchemy.engines [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81689) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG dbcounter [-] [81689] Writer thread running {{(pid=81689) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 25 15:46:19 devstack cinder-volume[81689]: INFO cinder.rpc [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 25 15:46:19 devstack cinder-volume[81689]: INFO cinder.rpc [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_db.sqlalchemy.engines [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81689) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 25 15:46:19 devstack cinder-volume[81689]: INFO cinder.volume.manager [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] Determined volume DB was empty at startup. Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG cinder.volume.manager [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81689) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 25 15:46:19 devstack cinder-volume[81689]: WARNING stevedore.named [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 25 15:46:19 devstack cinder-volume[81689]: WARNING castellan.key_manager [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 25 15:46:19 devstack cinder-volume[81689]: WARNING cinder.keymgr.conf_key_mgr [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 25 15:46:19 devstack cinder-volume[81689]: INFO cinder.volume.manager [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_db.sqlalchemy.engines [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81689) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 25 15:46:19 devstack cinder-volume[81689]: INFO oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] Starting 1 workers Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] Started child 81828 {{(pid=81689) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] Full set of CONF: {{(pid=81689) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] ******************************************************************************** {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] Configuration options gathered from: {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] ================================================================================ {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] allow_availability_zone_fallback = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] allow_compression_on_image_upload = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] allowed_direct_url_schemes = [] {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] api_rate_limit = True {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] auth_strategy = keystone {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_availability_zone = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_host = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_name = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_stats_polling_interval = 60 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backup_api_class = cinder.backup.api.API {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backup_name_template = backup-%s {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backup_use_same_host = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backup_use_temp_snapshot = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] chap_password = **** {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] chap_username = {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cinder_internal_tenant_project_id = 79df31b9be6c4bb4bea87087bba0cfd8 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cinder_internal_tenant_user_id = 2396e662689842b09266fbeda548f62a {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cluster = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] compression_format = gzip {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] compute_api_class = cinder.compute.nova.API {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] config_dir = [] {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] config_source = [] {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] control_exchange = openstack {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] debug = True {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] default_availability_zone = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] default_group_type = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] default_volume_type = QuobyteHD {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] disk_geometry = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] driver_client_cert = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] driver_client_cert_key = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] driver_data_namespace = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] driver_ssl_cert_path = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] driver_ssl_cert_verify = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] driver_use_ssl = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] enable_new_services = True {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] enable_unsupported_driver = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] enabled_backends = ['QuobyteHD'] {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] enforce_multipath_for_image_xfer = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] filter_function = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] glance_api_insecure = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] glance_api_servers = ['http://192.168.122.191/image'] {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] glance_api_ssl_compression = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] glance_ca_certificates_file = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] glance_catalog_info = image:glance:publicURL {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] glance_certfile = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] glance_keyfile = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] glance_num_retries = 3 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] glance_request_timeout = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] goodness_function = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] graceful_shutdown_timeout = 5 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81828]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] group_api_class = cinder.group.api.API {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] host = devstack {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] image_compress_on_upload = True {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] image_conversion_address_space_limit = 1 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] image_conversion_cpu_limit = 60 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] image_conversion_disable = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] image_upload_use_cinder_backend = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] image_upload_use_internal_tenant = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] image_volume_cache_enabled = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] image_volume_cache_max_count = 0 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] image_volume_cache_max_size_gb = 0 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] init_host_max_objects_retrieval = 0 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] instance_format = [instance: %(uuid)s] {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] iscsi_target_flags = {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] iscsi_write_cache = on {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] iser_helper = tgtadm {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] iser_ip_address = 192.168.122.191 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] iser_port = 3260 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] log_color = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] log_config_append = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] log_dir = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] log_file = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] log_options = True {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] log_rotate_interval = 1 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] log_rotate_interval_type = days {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] log_rotation_type = none {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] max_age = 0 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] max_logfile_count = 30 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] max_logfile_size_mb = 200 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] max_over_subscription_ratio = 20.0 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] message_reap_interval = 86400 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] message_ttl = 2592000 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] migration_create_volume_timeout_secs = 300 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] monkey_patch = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] monkey_patch_modules = [] {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] my_ip = 192.168.122.191 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] no_snapshot_gb_quota = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] num_iser_scan_tries = 3 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] num_shell_tries = 3 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] num_volume_device_scan_tries = 3 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] nvmeof_conn_info_version = 1 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] nvmet_ns_id = 10 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] nvmet_port_id = 1 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] osapi_max_limit = 1000 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] osapi_volume_ext_list = [] {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] osapi_volume_listen_port = 8776 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] osapi_volume_use_ssl = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] osapi_volume_workers = 2 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] per_volume_size_limit = -1 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] periodic_fuzzy_delay = 60 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] periodic_interval = 60 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] public_endpoint = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] publish_errors = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] quota_backup_gigabytes = 1000 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] quota_backups = 10 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] quota_gigabytes = 1000 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] quota_groups = 10 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] quota_snapshots = 10 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] quota_volumes = 10 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] rate_limit_burst = 0 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] rate_limit_except_level = CRITICAL {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] rate_limit_interval = 0 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] reinit_driver_count = 3 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] replication_device = **** {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] report_discard_supported = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] report_interval = 120 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] reservation_clean_interval = 86400 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] reservation_expire = 86400 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] reserved_image_namespaces = [] {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] reserved_percentage = 0 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] rpc_response_timeout = 120 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] run_external_periodic_tasks = True {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] scst_target_driver = iscsi {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] scst_target_iqn_name = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] service_down_time = 720 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] shell_completion = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] snapshot_name_template = snapshot-%s {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] split_loggers = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] state_path = /opt/stack/data/cinder {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] storage_availability_zone = nova {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] storage_protocol = iSCSI {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] syslog_log_facility = LOG_USER {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] target_helper = lioadm {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] target_ip_address = 192.168.122.191 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] target_port = 3260 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] target_protocol = iscsi {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] target_secondary_ip_addresses = [] {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] trace_flags = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] transport_url = **** {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] until_refresh = 0 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] use_chap_auth = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] use_default_quota_class = True {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] use_journal = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] use_json = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] use_multipath_for_image_xfer = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] use_stderr = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] use_syslog = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] verify_glance_signatures = enabled {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] volume_api_class = cinder.volume.api.API {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] volume_backend_name = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] volume_clear = zero {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] volume_clear_ionice = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] volume_clear_size = 0 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] volume_copy_bps_limit = 0 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] volume_dd_blocksize = 1M {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] volume_name_template = volume-%s {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] volume_service_inithost_offload = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] volume_usage_audit_period = month {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] zoning_mode = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_concurrency.disable_process_locking = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.admin_password = **** {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.admin_token = **** {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.admin_user = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.auth_port = 35357 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.auth_protocol = https {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.auth_section = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.auth_type = password {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.auth_uri = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.auth_version = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.cache = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.certfile = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.identity_uri = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.include_service_catalog = True {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.insecure = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.interface = public {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.keyfile = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.memcache_password = {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.memcache_username = {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.region_name = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.service_type = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.191/identity {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.backend = dogpile.cache.null {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.backend_argument = **** {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.backend_expiration_time = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.config_prefix = cache.oslo {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.debug_cache_backend = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.enable_retry_client = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.enable_socket_keepalive = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.enabled = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.enforce_fips_mode = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.expiration_time = 600 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.hashclient_retry_attempts = 2 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.memcache_dead_retry = 300 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.memcache_pool_maxsize = 10 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.memcache_sasl_enabled = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.password = **** {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.proxies = [] {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.redis_db = 0 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.redis_server = localhost:6379 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.retry_attempts = 2 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.retry_delay = 0.0 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.socket_keepalive_count = 1 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.socket_keepalive_idle = 1 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.socket_keepalive_interval = 1 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.socket_timeout = 1.0 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.tls_allowed_ciphers = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.tls_cafile = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.tls_certfile = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.tls_enabled = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.tls_keyfile = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cache.username = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] coordination.backend_url = **** {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] database.asyncio_connection = **** {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] database.asyncio_slave_connection = **** {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] database.backend = sqlalchemy {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] database.connection = **** {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] database.connection_debug = 0 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] database.connection_parameters = {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] database.connection_recycle_time = 3600 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] database.connection_trace = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] database.db_inc_retry_interval = True {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] database.db_max_retries = 20 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] database.db_max_retry_interval = 10 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] database.db_retry_interval = 1 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] database.max_overflow = 50 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] database.max_pool_size = 5 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] database.max_retries = 10 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] database.mysql_wsrep_sync_wait = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] database.pool_timeout = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] database.retry_interval = 10 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] database.slave_connection = **** {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] database.sqlite_synchronous = True {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] database.synchronous_reader = True {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] database.use_db_reconnect = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] profiler.connection_string = messaging:// {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] profiler.enabled = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] profiler.es_doc_type = notification {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] profiler.es_scroll_size = 10000 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] profiler.es_scroll_time = 2m {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] profiler.filter_error_trace = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] profiler.hmac_keys = **** {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] profiler.sentinel_service_name = mymaster {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] profiler.socket_timeout = 0.1 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] profiler.trace_requests = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] profiler.trace_sqlalchemy = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] profiler_jaeger.process_tags = {} {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] profiler_jaeger.service_name_prefix = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] profiler_otlp.service_name_prefix = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_policy.enforce_new_defaults = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: WARNING oslo_config.cfg [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_policy.enforce_scope = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_policy.policy_default_rule = default {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_policy.policy_file = policy.yaml {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] privsep_osbrick.group = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] privsep_osbrick.helper_command = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] privsep_osbrick.user = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cinder_sys_admin.group = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cinder_sys_admin.helper_command = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] cinder_sys_admin.user = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] service_user.auth_section = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] service_user.auth_type = password {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] service_user.cafile = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] service_user.certfile = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] service_user.collect_timing = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] service_user.insecure = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] service_user.keyfile = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] service_user.send_service_user_token = True {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] service_user.split_loggers = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] service_user.timeout = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] glance.auth_section = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] glance.auth_type = password {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] glance.certfile = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] glance.collect_timing = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] glance.insecure = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] glance.keyfile = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] glance.region_name = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] glance.split_loggers = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] glance.timeout = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.backend_availability_zone = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.chap_password = **** {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.chap_username = {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.disk_geometry = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.driver_client_cert = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.driver_client_cert_key = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.driver_data_namespace = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.driver_use_ssl = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.extra_capabilities = {} {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.filter_function = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.goodness_function = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.iscsi_target_flags = {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.iscsi_write_cache = on {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.iser_helper = tgtadm {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.iser_ip_address = 192.168.122.191 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.iser_port = 3260 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.nas_host = {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.nas_login = admin {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.nas_mount_options = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 25 15:46:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81828) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.nas_password = **** {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.nas_private_key = {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.nas_share_path = {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.num_shell_tries = 3 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.quobyte_volume_url = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.replication_device = **** {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.report_discard_supported = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.reserved_percentage = 0 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.target_helper = tgtadm {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.target_ip_address = 192.168.122.191 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.target_port = 3260 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.target_protocol = iscsi {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.trace_flags = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.unique_fqdn_network = True {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.use_chap_auth = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.volume_backend_name = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.volume_clear = zero {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.volume_clear_ionice = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.volume_clear_size = 0 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_reports.file_event_handler = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_reports.log_dir = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.backend_availability_zone = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.backend_host = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.chap_password = **** {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.chap_username = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.chiscsi_conf = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.disk_geometry = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.driver_client_cert = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.driver_data_namespace = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.driver_use_ssl = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.extra_capabilities = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.filter_function = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.goodness_function = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.iser_helper = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.iser_ip_address = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.iser_port = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.iser_target_prefix = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.nas_host = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.nas_login = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.nas_mount_options = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.nas_password = **** {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.nas_private_key = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.nas_share_path = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.nas_ssh_port = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.num_shell_tries = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.nvmet_port_id = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.replication_device = **** {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.report_discard_supported = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.reserved_percentage = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.scst_target_driver = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.storage_protocol = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.target_helper = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.target_ip_address = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.target_port = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.target_prefix = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.target_protocol = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.trace_flags = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.use_chap_auth = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.volume_clear = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.volume_clear_size = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] QuobyteHD.volumes_dir = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.ssl = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_notifications.driver = [] {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_notifications.retry = -1 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] key_manager.fixed_key = **** {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81828) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 25 15:46:19 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.quobyte [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 25 15:46:19 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.quobyte [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 25 15:46:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] Running cmd (subprocess): mount.quobyte {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] barbican.barbican_api_version = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] barbican.barbican_endpoint = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] barbican.barbican_endpoint_type = public {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] barbican.barbican_region_name = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] barbican.cafile = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] barbican.certfile = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] barbican.collect_timing = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] barbican.insecure = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] barbican.keyfile = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] barbican.number_of_retries = 60 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] barbican.retry_delay = 1 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] barbican.send_service_user_token = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] barbican.split_loggers = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] barbican.timeout = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] barbican.verify_ssl = True {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] barbican.verify_ssl_path = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] barbican_service_user.auth_section = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] barbican_service_user.auth_type = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] barbican_service_user.cafile = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] barbican_service_user.certfile = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] barbican_service_user.collect_timing = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] barbican_service_user.insecure = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] barbican_service_user.keyfile = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] barbican_service_user.split_loggers = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] barbican_service_user.timeout = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] vault.approle_role_id = **** {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] vault.approle_secret_id = **** {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] vault.kv_mountpoint = secret {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] vault.kv_path = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] vault.kv_version = 2 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] vault.namespace = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] vault.root_token_id = **** {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] vault.ssl_ca_crt_file = None {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] vault.timeout = 60.0 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] vault.use_ssl = False {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 25 15:46:19 devstack cinder-volume[81689]: DEBUG oslo_service.backend._eventlet.service [None req-9159e9ce-8b11-4759-bc9f-906906de6075 None None] ******************************************************************************** {{(pid=81689) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 25 15:46:19 devstack quobyte-client[81861]: Reading configuration file: /etc/quobyte/client.cfg Apr 25 15:46:19 devstack quobyte-client[81861]: Invalid parameters found, error: missing mount point. Apr 25 15:46:19 devstack quobyte-client[81861]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 25 15:46:19 devstack quobyte-client[81861]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 25 15:46:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] CMD "mount.quobyte" returned: 1 in 0.092s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:46:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:46:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:46:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:46:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:46:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:46:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:46:19 devstack sudo[81866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:46:19 devstack sudo[81866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:46:20 devstack sudo[81866]: pam_unix(sudo:session): session closed for user root Apr 25 15:46:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.886s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:46:20 devstack cinder-volume[81828]: INFO cinder.volume.driver [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] Driver hasn't implemented _init_vendor_properties() Apr 25 15:46:20 devstack cinder-volume[81828]: DEBUG cinder.volume.driver [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7188148498535, 'free_capacity_gb': 1775.7188148498535, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81828) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 25 15:46:20 devstack cinder-volume[81828]: DEBUG oslo_db.sqlalchemy.engines [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81828) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 25 15:46:20 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writer thread running {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 25 15:46:20 devstack cinder-volume[81828]: DEBUG cinder.db.sqlalchemy.api [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] Building query based on filter {{(pid=81828) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 25 15:46:20 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81828) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 25 15:46:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:46:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:46:20 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:46:20 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:46:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:46:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:46:20 devstack cinder-volume[81828]: INFO cinder.keymgr.migration [None req-c19ca543-937b-44c0-9895-9f2e979b4735 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 25 15:46:20 devstack sudo[81945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:46:20 devstack sudo[81945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:46:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.642s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:46:21 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:46:21 devstack sudo[81945]: pam_unix(sudo:session): session closed for user root Apr 25 15:46:21 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] Driver initialization completed successfully. Apr 25 15:46:21 devstack cinder-volume[81828]: INFO cinder.manager [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] Initiating service 3 cleanup Apr 25 15:46:21 devstack cinder-volume[81828]: INFO cinder.manager [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] Service 3 cleanup completed. Apr 25 15:46:21 devstack cinder-volume[81828]: DEBUG cinder.service [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] Creating RPC server for service cinder-volume {{(pid=81828) start /opt/stack/cinder/cinder/service.py:231}} Apr 25 15:46:21 devstack cinder-volume[81828]: DEBUG cinder.service [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81828) start /opt/stack/cinder/cinder/service.py:237}} Apr 25 15:46:21 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 25 15:46:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:46:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:46:21 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:46:21 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:46:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:46:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:46:21 devstack sudo[81973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:46:21 devstack sudo[81973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:46:22 devstack sudo[81973]: pam_unix(sudo:session): session closed for user root Apr 25 15:46:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.511s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:46:22 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-64ea77df-9046-4942-845b-71f4789102f0 None None] Driver post RPC initialization completed successfully. Apr 25 15:46:29 devstack cinder-volume[81689]: DEBUG dbcounter [-] [81689] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81689) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:46:31 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:SELECT=2 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:46:32 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:47:21 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:47:21 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] Flow 'volume_create_manager' (13952fba-31d1-4727-a6e3-e800e08f00c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:47:21 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09493e04-cf70-488b-9f25-564ead9519d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:21 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09493e04-cf70-488b-9f25-564ead9519d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1760442920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce4b26c8-d2c6-40f7-9acd-412651fe5e03,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b935bd26470415a98f819c30f5c4ed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:22Z,use_quota=True,user_id='0e837b31cd3745f89ef802c0e004815d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:21 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a71741e-2fdd-4af5-9499-681482a1aab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:21 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a71741e-2fdd-4af5-9499-681482a1aab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:21 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8ee8178-bdb7-4076-aab0-50bfadf05aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:21 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8ee8178-bdb7-4076-aab0-50bfadf05aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce4b26c8-d2c6-40f7-9acd-412651fe5e03', 'volume_name': 'volume-ce4b26c8-d2c6-40f7-9acd-412651fe5e03', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:21 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b16a2c3-45a0-449e-9805-b2a20005fe58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:21 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b16a2c3-45a0-449e-9805-b2a20005fe58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:21 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ae02ec4-734d-44f2-8338-4888eed0cca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:21 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] Volume ce4b26c8-d2c6-40f7-9acd-412651fe5e03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce4b26c8-d2c6-40f7-9acd-412651fe5e03', 'volume_size': 1} Apr 25 15:47:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:47:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:47:21 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:46:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1760442920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce4b26c8-d2c6-40f7-9acd-412651fe5e03,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b935bd26470415a98f819c30f5c4ed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:22Z,use_quota=True,user_id='0e837b31cd3745f89ef802c0e004815d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:47:21 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] Creating volume ce4b26c8-d2c6-40f7-9acd-412651fe5e03 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:47:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:47:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:47:21 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:47:22 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:47:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:47:22 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:47:22 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:47:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ce4b26c8-d2c6-40f7-9acd-412651fe5e03 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:22 devstack sudo[82390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ce4b26c8-d2c6-40f7-9acd-412651fe5e03 1073741824 Apr 25 15:47:22 devstack sudo[82390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:23 devstack sudo[82390]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ce4b26c8-d2c6-40f7-9acd-412651fe5e03 1073741824" returned: 0 in 1.055s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ce4b26c8-d2c6-40f7-9acd-412651fe5e03 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:23 devstack sudo[82720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ce4b26c8-d2c6-40f7-9acd-412651fe5e03 Apr 25 15:47:23 devstack sudo[82720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:23 devstack sudo[82720]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ce4b26c8-d2c6-40f7-9acd-412651fe5e03" returned: 0 in 0.712s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:23 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] <== create_volume: return (1843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:47:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:47:23 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ae02ec4-734d-44f2-8338-4888eed0cca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce4b26c8-d2c6-40f7-9acd-412651fe5e03', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:23 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5b8f9c0-a256-45fc-b2da-39739ee855f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:23 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] Volume volume-ce4b26c8-d2c6-40f7-9acd-412651fe5e03 (ce4b26c8-d2c6-40f7-9acd-412651fe5e03): created successfully Apr 25 15:47:23 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5b8f9c0-a256-45fc-b2da-39739ee855f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:23 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] Flow 'volume_create_manager' (13952fba-31d1-4727-a6e3-e800e08f00c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:47:23 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-0254da36-84da-406c-948c-10d3e6e7dcb5 tempest-VolumesTestJSON-1783746482 None] Created volume successfully. Apr 25 15:47:25 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:47:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] Flow 'volume_create_manager' (4117979b-973e-47a8-b079-4e5d1b8a3128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:47:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a79daae8-5dc7-404f-b617-05180d3dc0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a79daae8-5dc7-404f-b617-05180d3dc0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1676654560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cd55670-ef3c-4a70-a1fe-a50f8d7fa2c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0cc80b0b16d44a6b0b673328060184b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:25Z,use_quota=True,user_id='3de7d9746b894bcd8cb00dfa30c787af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5635504-5eb2-4b05-9d9d-017a2fda8c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5635504-5eb2-4b05-9d9d-017a2fda8c60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (841694c5-863d-442c-bc09-31fc03b3d311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (841694c5-863d-442c-bc09-31fc03b3d311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cd55670-ef3c-4a70-a1fe-a50f8d7fa2c8', 'volume_name': 'volume-0cd55670-ef3c-4a70-a1fe-a50f8d7fa2c8', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (434addbf-9878-4501-8c18-2c34b28a41cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (434addbf-9878-4501-8c18-2c34b28a41cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4143a525-0b50-4577-9bbd-364cbcceac65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:25 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] Volume 0cd55670-ef3c-4a70-a1fe-a50f8d7fa2c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cd55670-ef3c-4a70-a1fe-a50f8d7fa2c8', 'volume_size': 1} Apr 25 15:47:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:47:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:47:25 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1676654560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cd55670-ef3c-4a70-a1fe-a50f8d7fa2c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0cc80b0b16d44a6b0b673328060184b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:25Z,use_quota=True,user_id='3de7d9746b894bcd8cb00dfa30c787af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:47:25 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] Creating volume 0cd55670-ef3c-4a70-a1fe-a50f8d7fa2c8 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:47:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:47:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:47:25 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:47:25 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:47:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:47:25 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:47:25 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:47:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0cd55670-ef3c-4a70-a1fe-a50f8d7fa2c8 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:25 devstack sudo[82741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0cd55670-ef3c-4a70-a1fe-a50f8d7fa2c8 1073741824 Apr 25 15:47:25 devstack sudo[82741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:26 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:47:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] Flow 'volume_create_manager' (ff75e00b-4b0e-4812-b992-f9fddbe3b9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:47:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74601f5d-07ba-44e9-bf58-147ccd673a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74601f5d-07ba-44e9-bf58-147ccd673a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1695840061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb2c0dc7-1ee7-4119-8066-ce5a47e807df,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b935bd26470415a98f819c30f5c4ed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:26Z,use_quota=True,user_id='0e837b31cd3745f89ef802c0e004815d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (432592bf-af5b-4adb-8c33-e2e461c944f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (432592bf-af5b-4adb-8c33-e2e461c944f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6019e499-8cff-4b14-857d-40052cae11dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6019e499-8cff-4b14-857d-40052cae11dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb2c0dc7-1ee7-4119-8066-ce5a47e807df', 'volume_name': 'volume-cb2c0dc7-1ee7-4119-8066-ce5a47e807df', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (390d371e-6655-4d4e-aaa8-7dbd48e2bc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (390d371e-6655-4d4e-aaa8-7dbd48e2bc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ae5a08-14a1-4856-90a8-4a6f02d9fbe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:26 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] Volume cb2c0dc7-1ee7-4119-8066-ce5a47e807df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb2c0dc7-1ee7-4119-8066-ce5a47e807df', 'volume_size': 1} Apr 25 15:47:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:47:26 devstack sudo[82741]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0cd55670-ef3c-4a70-a1fe-a50f8d7fa2c8 1073741824" returned: 0 in 1.482s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0cd55670-ef3c-4a70-a1fe-a50f8d7fa2c8 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:27 devstack sudo[82750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0cd55670-ef3c-4a70-a1fe-a50f8d7fa2c8 Apr 25 15:47:27 devstack sudo[82750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:27 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:47:27 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] Flow 'volume_create_manager' (730f90b3-6464-4d6b-aa28-0fb2fb2f14c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:47:27 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dafd8054-0d0e-4a33-a58f-e982b74debbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:27 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dafd8054-0d0e-4a33-a58f-e982b74debbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1820478168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f36a306a-2b34-4be0-a78d-0b2198713200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c88dc200fb94cb3b3568acde8ab5ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:28Z,use_quota=True,user_id='e70a34e5ae4049e5b5b83b5c7aa50d96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:27 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c97c9f77-e1a3-47f8-b9f1-7dc676bcb238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:27 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c97c9f77-e1a3-47f8-b9f1-7dc676bcb238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:27 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad3bd68f-d60d-44c7-80b5-3cbd6dba86b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:27 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad3bd68f-d60d-44c7-80b5-3cbd6dba86b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f36a306a-2b34-4be0-a78d-0b2198713200', 'volume_name': 'volume-f36a306a-2b34-4be0-a78d-0b2198713200', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:27 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85f83eb1-fffa-445f-bc36-9beef2b45109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:27 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85f83eb1-fffa-445f-bc36-9beef2b45109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:27 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82accbeb-905d-41b7-a780-303d2707b6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:27 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] Volume f36a306a-2b34-4be0-a78d-0b2198713200: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f36a306a-2b34-4be0-a78d-0b2198713200', 'volume_size': 1} Apr 25 15:47:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:47:28 devstack sudo[82750]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0cd55670-ef3c-4a70-a1fe-a50f8d7fa2c8" returned: 0 in 1.415s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:28 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] <== create_volume: return (2955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:47:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.958s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:47:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.979s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:47:28 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1695840061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb2c0dc7-1ee7-4119-8066-ce5a47e807df,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b935bd26470415a98f819c30f5c4ed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:26Z,use_quota=True,user_id='0e837b31cd3745f89ef802c0e004815d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:47:28 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] Creating volume cb2c0dc7-1ee7-4119-8066-ce5a47e807df {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:47:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:47:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:47:28 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:47:28 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:47:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:47:28 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:47:28 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:47:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-cb2c0dc7-1ee7-4119-8066-ce5a47e807df 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:28 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4143a525-0b50-4577-9bbd-364cbcceac65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cd55670-ef3c-4a70-a1fe-a50f8d7fa2c8', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:28 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed825506-9e77-4f6c-aa6f-9007d640929c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:28 devstack sudo[82754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-cb2c0dc7-1ee7-4119-8066-ce5a47e807df 1073741824 Apr 25 15:47:28 devstack sudo[82754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:28 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] Volume volume-0cd55670-ef3c-4a70-a1fe-a50f8d7fa2c8 (0cd55670-ef3c-4a70-a1fe-a50f8d7fa2c8): created successfully Apr 25 15:47:28 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed825506-9e77-4f6c-aa6f-9007d640929c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:28 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] Flow 'volume_create_manager' (4117979b-973e-47a8-b079-4e5d1b8a3128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:47:28 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-224fe6ab-f502-4653-8fae-8c1a79aef962 tempest-VolumesAdminNegativeTest-85711077 None] Created volume successfully. Apr 25 15:47:29 devstack sudo[82754]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-cb2c0dc7-1ee7-4119-8066-ce5a47e807df 1073741824" returned: 0 in 1.083s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-cb2c0dc7-1ee7-4119-8066-ce5a47e807df {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:29 devstack sudo[82760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-cb2c0dc7-1ee7-4119-8066-ce5a47e807df Apr 25 15:47:29 devstack sudo[82760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:30 devstack sudo[82760]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-cb2c0dc7-1ee7-4119-8066-ce5a47e807df" returned: 0 in 0.735s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] <== create_volume: return (1914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:47:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.919s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:47:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.451s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:47:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:47:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1820478168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f36a306a-2b34-4be0-a78d-0b2198713200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c88dc200fb94cb3b3568acde8ab5ddb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:28Z,use_quota=True,user_id='e70a34e5ae4049e5b5b83b5c7aa50d96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:47:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] Creating volume f36a306a-2b34-4be0-a78d-0b2198713200 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:47:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:47:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:47:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:47:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:47:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:47:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:47:30 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:47:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f36a306a-2b34-4be0-a78d-0b2198713200 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ae5a08-14a1-4856-90a8-4a6f02d9fbe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb2c0dc7-1ee7-4119-8066-ce5a47e807df', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:30 devstack sudo[82763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f36a306a-2b34-4be0-a78d-0b2198713200 1073741824 Apr 25 15:47:30 devstack sudo[82763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e859ef30-e75a-4890-885f-1d64bfb2e74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:30 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] Volume volume-cb2c0dc7-1ee7-4119-8066-ce5a47e807df (cb2c0dc7-1ee7-4119-8066-ce5a47e807df): created successfully Apr 25 15:47:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e859ef30-e75a-4890-885f-1d64bfb2e74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] Flow 'volume_create_manager' (ff75e00b-4b0e-4812-b992-f9fddbe3b9d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:47:30 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3642dba1-fe33-4b6b-8aea-3a3725ba725d tempest-VolumesAdminNegativeTest-85711077 None] Acquiring lock "cinder-0cd55670-ef3c-4a70-a1fe-a50f8d7fa2c8-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:47:30 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-8eb8f84b-a8af-4a9b-b745-d4b5442e9bc4 tempest-VolumesTestJSON-1783746482 None] Created volume successfully. Apr 25 15:47:30 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3642dba1-fe33-4b6b-8aea-3a3725ba725d tempest-VolumesAdminNegativeTest-85711077 None] Lock "cinder-0cd55670-ef3c-4a70-a1fe-a50f8d7fa2c8-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:47:30 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3642dba1-fe33-4b6b-8aea-3a3725ba725d tempest-VolumesAdminNegativeTest-85711077 None] Acquiring lock "cinder-quobyte-0cd55670-ef3c-4a70-a1fe-a50f8d7fa2c8" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:47:30 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3642dba1-fe33-4b6b-8aea-3a3725ba725d tempest-VolumesAdminNegativeTest-85711077 None] Lock "cinder-quobyte-0cd55670-ef3c-4a70-a1fe-a50f8d7fa2c8" acquired by "delete_volume" :: waited 0.026s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:47:30 devstack cinder-volume[81828]: INFO oslo.privsep.daemon [None req-3642dba1-fe33-4b6b-8aea-3a3725ba725d tempest-VolumesAdminNegativeTest-85711077 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpu2xedzpn/privsep.sock'] Apr 25 15:47:30 devstack sudo[82766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpu2xedzpn/privsep.sock Apr 25 15:47:30 devstack sudo[82766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:31 devstack sudo[82763]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f36a306a-2b34-4be0-a78d-0b2198713200 1073741824" returned: 0 in 1.422s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:31 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:47:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] Flow 'volume_create_manager' (29e40647-07b2-4297-bf0b-a74faecb3212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:47:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea181b17-243e-4c55-a437-d9102e32eaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f36a306a-2b34-4be0-a78d-0b2198713200 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:31 devstack sudo[82772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f36a306a-2b34-4be0-a78d-0b2198713200 Apr 25 15:47:31 devstack sudo[82772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea181b17-243e-4c55-a437-d9102e32eaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1866965066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93a55338-2e05-464c-9e41-1048746ddeec,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b935bd26470415a98f819c30f5c4ed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:32Z,use_quota=True,user_id='0e837b31cd3745f89ef802c0e004815d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b5c4bc4-a526-4892-afd9-a97084f88825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b5c4bc4-a526-4892-afd9-a97084f88825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57e0e9e4-21a5-4775-a557-05fbcd80224c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57e0e9e4-21a5-4775-a557-05fbcd80224c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93a55338-2e05-464c-9e41-1048746ddeec', 'volume_name': 'volume-93a55338-2e05-464c-9e41-1048746ddeec', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1da27144-2555-4787-9c79-dc16f73ef168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1da27144-2555-4787-9c79-dc16f73ef168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a18716-a536-4d6c-b4f1-30e98ca82e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:31 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] Volume 93a55338-2e05-464c-9e41-1048746ddeec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93a55338-2e05-464c-9e41-1048746ddeec', 'volume_size': 1} Apr 25 15:47:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:47:31 devstack cinder-volume[81828]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 25 15:47:31 devstack cinder-volume[81828]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 25 15:47:31 devstack cinder-volume[81828]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 25 15:47:31 devstack cinder-volume[81828]: WARNING oslo.privsep.daemon [-] privsep log: Apr 25 15:47:31 devstack cinder-volume[81828]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 25 15:47:31 devstack cinder-volume[81828]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 25 15:47:31 devstack cinder-volume[81828]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 25 15:47:31 devstack cinder-volume[81828]: WARNING oslo.privsep.daemon [-] privsep log: Apr 25 15:47:31 devstack cinder-volume[81828]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 25 15:47:32 devstack cinder-volume[81828]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 25 15:47:32 devstack cinder-volume[81828]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 25 15:47:32 devstack cinder-volume[81828]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 25 15:47:32 devstack cinder-volume[81828]: WARNING oslo.privsep.daemon [-] privsep log: Apr 25 15:47:32 devstack cinder-volume[81828]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 25 15:47:32 devstack cinder-volume[81828]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 25 15:47:32 devstack cinder-volume[81828]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 25 15:47:32 devstack cinder-volume[81828]: WARNING oslo.privsep.daemon [-] privsep log: Apr 25 15:47:32 devstack cinder-volume[81828]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 25 15:47:33 devstack sudo[82772]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f36a306a-2b34-4be0-a78d-0b2198713200" returned: 0 in 1.315s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:33 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] <== create_volume: return (2814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:47:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.827s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:47:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.212s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:47:33 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1866965066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93a55338-2e05-464c-9e41-1048746ddeec,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6b935bd26470415a98f819c30f5c4ed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:32Z,use_quota=True,user_id='0e837b31cd3745f89ef802c0e004815d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:47:33 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] Creating volume 93a55338-2e05-464c-9e41-1048746ddeec {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:47:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:47:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:47:33 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:47:33 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:47:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:47:33 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:47:33 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:47:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-93a55338-2e05-464c-9e41-1048746ddeec 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:33 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82accbeb-905d-41b7-a780-303d2707b6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f36a306a-2b34-4be0-a78d-0b2198713200', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:33 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8e76e9e-ea49-43a4-998a-b34009f42f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:33 devstack sudo[82777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-93a55338-2e05-464c-9e41-1048746ddeec 1073741824 Apr 25 15:47:33 devstack sudo[82777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:33 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] Volume volume-f36a306a-2b34-4be0-a78d-0b2198713200 (f36a306a-2b34-4be0-a78d-0b2198713200): created successfully Apr 25 15:47:33 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8e76e9e-ea49-43a4-998a-b34009f42f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:33 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] Flow 'volume_create_manager' (730f90b3-6464-4d6b-aa28-0fb2fb2f14c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:47:33 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-1b2fcf9b-6cad-4e5a-92fc-9cecda27de24 tempest-DeleteServersTestJSON-997495508 None] Created volume successfully. Apr 25 15:47:33 devstack sudo[82766]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:33 devstack cinder-volume[81828]: INFO oslo.privsep.daemon [None req-3642dba1-fe33-4b6b-8aea-3a3725ba725d tempest-VolumesAdminNegativeTest-85711077 None] Spawned new privsep daemon via rootwrap Apr 25 15:47:33 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [None req-3642dba1-fe33-4b6b-8aea-3a3725ba725d tempest-VolumesAdminNegativeTest-85711077 None] Accepted privsep connection to /tmp/tmpu2xedzpn/privsep.sock {{(pid=81828) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 25 15:47:33 devstack cinder-volume[81828]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 25 15:47:33 devstack cinder-volume[81828]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 25 15:47:33 devstack cinder-volume[81828]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 25 15:47:33 devstack cinder-volume[81828]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82776 Apr 25 15:47:33 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b6a473-9ae9-4b51-84bd-a7fc226ec60a]: (2,) {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:47:33 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d300e3-0cb8-4d48-922d-b63014997a33]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:47:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3642dba1-fe33-4b6b-8aea-3a3725ba725d tempest-VolumesAdminNegativeTest-85711077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0cd55670-ef3c-4a70-a1fe-a50f8d7fa2c8 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:34 devstack sudo[82780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0cd55670-ef3c-4a70-a1fe-a50f8d7fa2c8 Apr 25 15:47:34 devstack sudo[82780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:34 devstack sudo[82780]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3642dba1-fe33-4b6b-8aea-3a3725ba725d tempest-VolumesAdminNegativeTest-85711077 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0cd55670-ef3c-4a70-a1fe-a50f8d7fa2c8" returned: 0 in 1.121s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3642dba1-fe33-4b6b-8aea-3a3725ba725d tempest-VolumesAdminNegativeTest-85711077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0cd55670-ef3c-4a70-a1fe-a50f8d7fa2c8 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:34 devstack sudo[82825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0cd55670-ef3c-4a70-a1fe-a50f8d7fa2c8 Apr 25 15:47:34 devstack sudo[82825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:34 devstack sudo[82777]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-93a55338-2e05-464c-9e41-1048746ddeec 1073741824" returned: 0 in 1.731s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-93a55338-2e05-464c-9e41-1048746ddeec {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:35 devstack sudo[82828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-93a55338-2e05-464c-9e41-1048746ddeec Apr 25 15:47:35 devstack sudo[82828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:35 devstack sudo[82825]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3642dba1-fe33-4b6b-8aea-3a3725ba725d tempest-VolumesAdminNegativeTest-85711077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0cd55670-ef3c-4a70-a1fe-a50f8d7fa2c8" returned: 0 in 0.661s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:35 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3642dba1-fe33-4b6b-8aea-3a3725ba725d tempest-VolumesAdminNegativeTest-85711077 None] Lock "cinder-quobyte-0cd55670-ef3c-4a70-a1fe-a50f8d7fa2c8" released by "delete_volume" :: held 4.666s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:47:35 devstack cinder-volume[81828]: WARNING cinder.quota [None req-3642dba1-fe33-4b6b-8aea-3a3725ba725d tempest-VolumesAdminNegativeTest-85711077 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 25 15:47:35 devstack cinder-volume[81828]: WARNING cinder.quota [None req-3642dba1-fe33-4b6b-8aea-3a3725ba725d tempest-VolumesAdminNegativeTest-85711077 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 25 15:47:35 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-3642dba1-fe33-4b6b-8aea-3a3725ba725d tempest-VolumesAdminNegativeTest-85711077 None] Created reservations ['739c35cd-631a-4256-8a97-6e4f6abab074', '382a86c8-b015-4273-9e71-cd1266897ac6', '5fe1277b-7f7b-4ff1-aabd-06d86c5a3945', 'cb47683b-5b13-466a-a309-5f6a78d10f23'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:47:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3642dba1-fe33-4b6b-8aea-3a3725ba725d tempest-VolumesAdminNegativeTest-85711077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:47:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3642dba1-fe33-4b6b-8aea-3a3725ba725d tempest-VolumesAdminNegativeTest-85711077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:47:35 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3642dba1-fe33-4b6b-8aea-3a3725ba725d tempest-VolumesAdminNegativeTest-85711077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:47:35 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3642dba1-fe33-4b6b-8aea-3a3725ba725d tempest-VolumesAdminNegativeTest-85711077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:47:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3642dba1-fe33-4b6b-8aea-3a3725ba725d tempest-VolumesAdminNegativeTest-85711077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:47:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3642dba1-fe33-4b6b-8aea-3a3725ba725d tempest-VolumesAdminNegativeTest-85711077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:35 devstack sudo[82834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:47:35 devstack sudo[82834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:35 devstack sudo[82828]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-93a55338-2e05-464c-9e41-1048746ddeec" returned: 0 in 0.821s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:35 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] <== create_volume: return (2637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:47:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.641s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:47:35 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31a18716-a536-4d6c-b4f1-30e98ca82e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93a55338-2e05-464c-9e41-1048746ddeec', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:35 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f28d0d81-68b6-4980-9881-e9c32bd19327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:35 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] Volume volume-93a55338-2e05-464c-9e41-1048746ddeec (93a55338-2e05-464c-9e41-1048746ddeec): created successfully Apr 25 15:47:35 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f28d0d81-68b6-4980-9881-e9c32bd19327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:35 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] Flow 'volume_create_manager' (29e40647-07b2-4297-bf0b-a74faecb3212) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:47:35 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-3583b91e-fa40-440e-8850-db3d281c8ac3 tempest-VolumesTestJSON-1783746482 None] Created volume successfully. Apr 25 15:47:36 devstack sudo[82834]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3642dba1-fe33-4b6b-8aea-3a3725ba725d tempest-VolumesAdminNegativeTest-85711077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.619s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:36 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-3642dba1-fe33-4b6b-8aea-3a3725ba725d tempest-VolumesAdminNegativeTest-85711077 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:47:36 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-3642dba1-fe33-4b6b-8aea-3a3725ba725d tempest-VolumesAdminNegativeTest-85711077 None] Deleted volume successfully. Apr 25 15:47:36 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3642dba1-fe33-4b6b-8aea-3a3725ba725d tempest-VolumesAdminNegativeTest-85711077 None] Lock "cinder-0cd55670-ef3c-4a70-a1fe-a50f8d7fa2c8-delete_volume" released by "delete_volume" :: held 5.773s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:47:38 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d1880d69-433a-44c8-87e7-3048dd7760f9 tempest-VolumesTestJSON-1783746482 None] Acquiring lock "cinder-93a55338-2e05-464c-9e41-1048746ddeec-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:47:38 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d1880d69-433a-44c8-87e7-3048dd7760f9 tempest-VolumesTestJSON-1783746482 None] Lock "cinder-93a55338-2e05-464c-9e41-1048746ddeec-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:47:38 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d1880d69-433a-44c8-87e7-3048dd7760f9 tempest-VolumesTestJSON-1783746482 None] Acquiring lock "cinder-quobyte-93a55338-2e05-464c-9e41-1048746ddeec" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:47:38 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d1880d69-433a-44c8-87e7-3048dd7760f9 tempest-VolumesTestJSON-1783746482 None] Lock "cinder-quobyte-93a55338-2e05-464c-9e41-1048746ddeec" acquired by "delete_volume" :: waited 0.039s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:47:38 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f06989-486e-4fe2-8c12-265e1493762e]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:47:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d1880d69-433a-44c8-87e7-3048dd7760f9 tempest-VolumesTestJSON-1783746482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-93a55338-2e05-464c-9e41-1048746ddeec {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:38 devstack sudo[82868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-93a55338-2e05-464c-9e41-1048746ddeec Apr 25 15:47:38 devstack sudo[82868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:40 devstack sudo[82868]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d1880d69-433a-44c8-87e7-3048dd7760f9 tempest-VolumesTestJSON-1783746482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-93a55338-2e05-464c-9e41-1048746ddeec" returned: 0 in 1.465s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d1880d69-433a-44c8-87e7-3048dd7760f9 tempest-VolumesTestJSON-1783746482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-93a55338-2e05-464c-9e41-1048746ddeec {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:40 devstack sudo[82898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-93a55338-2e05-464c-9e41-1048746ddeec Apr 25 15:47:40 devstack sudo[82898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:40 devstack cinder-volume[81828]: WARNING py.warnings [req-9518565c-f477-4524-9744-45fd68ccd2b9 req-928a75ea-9da9-4b73-bf6a-1518258e8465 tempest-DeleteServersTestJSON-997495508 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Apr 25 15:47:40 devstack cinder-volume[81828]: .first() Apr 25 15:47:40 devstack cinder-volume[81828]: Apr 25 15:47:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-9518565c-f477-4524-9744-45fd68ccd2b9 req-928a75ea-9da9-4b73-bf6a-1518258e8465 tempest-DeleteServersTestJSON-997495508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:47:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-9518565c-f477-4524-9744-45fd68ccd2b9 req-928a75ea-9da9-4b73-bf6a-1518258e8465 tempest-DeleteServersTestJSON-997495508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:47:40 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[f745e0d8-4805-4683-a046-38b0419db860]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:47:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-9518565c-f477-4524-9744-45fd68ccd2b9 req-928a75ea-9da9-4b73-bf6a-1518258e8465 tempest-DeleteServersTestJSON-997495508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f36a306a-2b34-4be0-a78d-0b2198713200 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:40 devstack sudo[82898]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d1880d69-433a-44c8-87e7-3048dd7760f9 tempest-VolumesTestJSON-1783746482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-93a55338-2e05-464c-9e41-1048746ddeec" returned: 0 in 0.827s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:40 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d1880d69-433a-44c8-87e7-3048dd7760f9 tempest-VolumesTestJSON-1783746482 None] Lock "cinder-quobyte-93a55338-2e05-464c-9e41-1048746ddeec" released by "delete_volume" :: held 2.440s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:47:41 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-d1880d69-433a-44c8-87e7-3048dd7760f9 tempest-VolumesTestJSON-1783746482 None] Created reservations ['d80f4bab-501f-44df-8ddf-6f83aacb6841', 'dc268e08-04bc-4dc0-bd57-f092ac15d805', '153695da-309c-4bea-ba80-fc8003a1c078', '2225507a-faa7-47dd-aefa-132921cbaa43'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:47:41 devstack sudo[82914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f36a306a-2b34-4be0-a78d-0b2198713200 Apr 25 15:47:41 devstack sudo[82914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d1880d69-433a-44c8-87e7-3048dd7760f9 tempest-VolumesTestJSON-1783746482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:47:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d1880d69-433a-44c8-87e7-3048dd7760f9 tempest-VolumesTestJSON-1783746482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:47:41 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d1880d69-433a-44c8-87e7-3048dd7760f9 tempest-VolumesTestJSON-1783746482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:47:41 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d1880d69-433a-44c8-87e7-3048dd7760f9 tempest-VolumesTestJSON-1783746482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:47:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d1880d69-433a-44c8-87e7-3048dd7760f9 tempest-VolumesTestJSON-1783746482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:47:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d1880d69-433a-44c8-87e7-3048dd7760f9 tempest-VolumesTestJSON-1783746482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:41 devstack sudo[82918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:47:41 devstack sudo[82918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:41 devstack sudo[82914]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-9518565c-f477-4524-9744-45fd68ccd2b9 req-928a75ea-9da9-4b73-bf6a-1518258e8465 tempest-DeleteServersTestJSON-997495508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f36a306a-2b34-4be0-a78d-0b2198713200" returned: 0 in 0.668s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-9518565c-f477-4524-9744-45fd68ccd2b9 req-928a75ea-9da9-4b73-bf6a-1518258e8465 tempest-DeleteServersTestJSON-997495508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.687s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:47:41 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-9518565c-f477-4524-9744-45fd68ccd2b9 req-928a75ea-9da9-4b73-bf6a-1518258e8465 tempest-DeleteServersTestJSON-997495508 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf', 'name': 'volume-f36a306a-2b34-4be0-a78d-0b2198713200', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed0f1bb2-68ef-4bd4-b480-2c549befb26a', 'enforce_multipath': True} {{(pid=81828) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 25 15:47:41 devstack sudo[82918]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d1880d69-433a-44c8-87e7-3048dd7760f9 tempest-VolumesTestJSON-1783746482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.564s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:41 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-d1880d69-433a-44c8-87e7-3048dd7760f9 tempest-VolumesTestJSON-1783746482 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:47:41 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-d1880d69-433a-44c8-87e7-3048dd7760f9 tempest-VolumesTestJSON-1783746482 None] Deleted volume successfully. Apr 25 15:47:41 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d1880d69-433a-44c8-87e7-3048dd7760f9 tempest-VolumesTestJSON-1783746482 None] Lock "cinder-93a55338-2e05-464c-9e41-1048746ddeec-delete_volume" released by "delete_volume" :: held 3.524s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:47:41 devstack cinder-volume[81828]: INFO cinder.volume.manager [req-9518565c-f477-4524-9744-45fd68ccd2b9 req-928a75ea-9da9-4b73-bf6a-1518258e8465 tempest-DeleteServersTestJSON-997495508 None] attachment_update completed successfully. Apr 25 15:47:41 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7da10b35-751d-4ae7-8b3e-ab825ca07b64 tempest-VolumesTestJSON-1783746482 None] Acquiring lock "cinder-cb2c0dc7-1ee7-4119-8066-ce5a47e807df-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:47:41 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7da10b35-751d-4ae7-8b3e-ab825ca07b64 tempest-VolumesTestJSON-1783746482 None] Lock "cinder-cb2c0dc7-1ee7-4119-8066-ce5a47e807df-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:47:41 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7da10b35-751d-4ae7-8b3e-ab825ca07b64 tempest-VolumesTestJSON-1783746482 None] Acquiring lock "cinder-quobyte-cb2c0dc7-1ee7-4119-8066-ce5a47e807df" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:47:41 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7da10b35-751d-4ae7-8b3e-ab825ca07b64 tempest-VolumesTestJSON-1783746482 None] Lock "cinder-quobyte-cb2c0dc7-1ee7-4119-8066-ce5a47e807df" acquired by "delete_volume" :: waited 0.021s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:47:42 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[025f9343-25f4-4760-8877-b20697683c1c]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:47:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7da10b35-751d-4ae7-8b3e-ab825ca07b64 tempest-VolumesTestJSON-1783746482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-cb2c0dc7-1ee7-4119-8066-ce5a47e807df {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:42 devstack sudo[82925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-cb2c0dc7-1ee7-4119-8066-ce5a47e807df Apr 25 15:47:42 devstack sudo[82925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:42 devstack sudo[82925]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7da10b35-751d-4ae7-8b3e-ab825ca07b64 tempest-VolumesTestJSON-1783746482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-cb2c0dc7-1ee7-4119-8066-ce5a47e807df" returned: 0 in 0.644s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7da10b35-751d-4ae7-8b3e-ab825ca07b64 tempest-VolumesTestJSON-1783746482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-cb2c0dc7-1ee7-4119-8066-ce5a47e807df {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:42 devstack sudo[82996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-cb2c0dc7-1ee7-4119-8066-ce5a47e807df Apr 25 15:47:42 devstack sudo[82996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:43 devstack sudo[82996]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7da10b35-751d-4ae7-8b3e-ab825ca07b64 tempest-VolumesTestJSON-1783746482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-cb2c0dc7-1ee7-4119-8066-ce5a47e807df" returned: 0 in 0.631s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7da10b35-751d-4ae7-8b3e-ab825ca07b64 tempest-VolumesTestJSON-1783746482 None] Lock "cinder-quobyte-cb2c0dc7-1ee7-4119-8066-ce5a47e807df" released by "delete_volume" :: held 1.335s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:47:43 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-7da10b35-751d-4ae7-8b3e-ab825ca07b64 tempest-VolumesTestJSON-1783746482 None] Created reservations ['239f67de-bf18-4a0c-bfa2-0ad2b9d2bd2b', '66eed52a-60d3-4ba0-ac19-3cb0600ff794', 'ab59eb30-1b84-4ecd-9afe-20ce6e4304cb', '81b2a867-f1d8-4fbe-9528-ccd6686ddb66'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:47:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7da10b35-751d-4ae7-8b3e-ab825ca07b64 tempest-VolumesTestJSON-1783746482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:47:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7da10b35-751d-4ae7-8b3e-ab825ca07b64 tempest-VolumesTestJSON-1783746482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:47:43 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-7da10b35-751d-4ae7-8b3e-ab825ca07b64 tempest-VolumesTestJSON-1783746482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:47:43 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-7da10b35-751d-4ae7-8b3e-ab825ca07b64 tempest-VolumesTestJSON-1783746482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:47:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7da10b35-751d-4ae7-8b3e-ab825ca07b64 tempest-VolumesTestJSON-1783746482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:47:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7da10b35-751d-4ae7-8b3e-ab825ca07b64 tempest-VolumesTestJSON-1783746482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:43 devstack sudo[83320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:47:43 devstack sudo[83320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:43 devstack sudo[83320]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7da10b35-751d-4ae7-8b3e-ab825ca07b64 tempest-VolumesTestJSON-1783746482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.497s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:43 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-7da10b35-751d-4ae7-8b3e-ab825ca07b64 tempest-VolumesTestJSON-1783746482 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:47:43 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-7da10b35-751d-4ae7-8b3e-ab825ca07b64 tempest-VolumesTestJSON-1783746482 None] Deleted volume successfully. Apr 25 15:47:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7da10b35-751d-4ae7-8b3e-ab825ca07b64 tempest-VolumesTestJSON-1783746482 None] Lock "cinder-cb2c0dc7-1ee7-4119-8066-ce5a47e807df-delete_volume" released by "delete_volume" :: held 2.078s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:47:44 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c26337bf-c9ad-4e60-9dc3-18be22e703a8 tempest-VolumesTestJSON-1783746482 None] Acquiring lock "cinder-ce4b26c8-d2c6-40f7-9acd-412651fe5e03-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:47:44 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c26337bf-c9ad-4e60-9dc3-18be22e703a8 tempest-VolumesTestJSON-1783746482 None] Lock "cinder-ce4b26c8-d2c6-40f7-9acd-412651fe5e03-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:47:44 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c26337bf-c9ad-4e60-9dc3-18be22e703a8 tempest-VolumesTestJSON-1783746482 None] Acquiring lock "cinder-quobyte-ce4b26c8-d2c6-40f7-9acd-412651fe5e03" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:47:44 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c26337bf-c9ad-4e60-9dc3-18be22e703a8 tempest-VolumesTestJSON-1783746482 None] Lock "cinder-quobyte-ce4b26c8-d2c6-40f7-9acd-412651fe5e03" acquired by "delete_volume" :: waited 0.019s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:47:44 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[43001d66-760a-4d19-8d3e-67cf95e201cc]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:47:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c26337bf-c9ad-4e60-9dc3-18be22e703a8 tempest-VolumesTestJSON-1783746482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ce4b26c8-d2c6-40f7-9acd-412651fe5e03 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:44 devstack sudo[83323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ce4b26c8-d2c6-40f7-9acd-412651fe5e03 Apr 25 15:47:44 devstack sudo[83323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:44 devstack sudo[83323]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c26337bf-c9ad-4e60-9dc3-18be22e703a8 tempest-VolumesTestJSON-1783746482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ce4b26c8-d2c6-40f7-9acd-412651fe5e03" returned: 0 in 0.650s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c26337bf-c9ad-4e60-9dc3-18be22e703a8 tempest-VolumesTestJSON-1783746482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ce4b26c8-d2c6-40f7-9acd-412651fe5e03 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:45 devstack sudo[83328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ce4b26c8-d2c6-40f7-9acd-412651fe5e03 Apr 25 15:47:45 devstack sudo[83328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:45 devstack sudo[83328]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c26337bf-c9ad-4e60-9dc3-18be22e703a8 tempest-VolumesTestJSON-1783746482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ce4b26c8-d2c6-40f7-9acd-412651fe5e03" returned: 0 in 0.650s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:45 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c26337bf-c9ad-4e60-9dc3-18be22e703a8 tempest-VolumesTestJSON-1783746482 None] Lock "cinder-quobyte-ce4b26c8-d2c6-40f7-9acd-412651fe5e03" released by "delete_volume" :: held 1.345s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:47:45 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-c26337bf-c9ad-4e60-9dc3-18be22e703a8 tempest-VolumesTestJSON-1783746482 None] Created reservations ['d755461b-cd1f-4a72-a541-5b6e09df60a1', '1fe60fb3-d9d9-4cb5-8258-69e9e5821b17', 'aa688886-9f43-4bcd-aba1-02d1f9835bbd', 'df5439e8-9f21-40b3-ae8b-070e5a6f1ad3'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:47:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c26337bf-c9ad-4e60-9dc3-18be22e703a8 tempest-VolumesTestJSON-1783746482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:47:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c26337bf-c9ad-4e60-9dc3-18be22e703a8 tempest-VolumesTestJSON-1783746482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:47:45 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c26337bf-c9ad-4e60-9dc3-18be22e703a8 tempest-VolumesTestJSON-1783746482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:47:45 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c26337bf-c9ad-4e60-9dc3-18be22e703a8 tempest-VolumesTestJSON-1783746482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:47:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c26337bf-c9ad-4e60-9dc3-18be22e703a8 tempest-VolumesTestJSON-1783746482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:47:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c26337bf-c9ad-4e60-9dc3-18be22e703a8 tempest-VolumesTestJSON-1783746482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:45 devstack sudo[83331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:47:45 devstack sudo[83331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:46 devstack sudo[83331]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c26337bf-c9ad-4e60-9dc3-18be22e703a8 tempest-VolumesTestJSON-1783746482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.699s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:46 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-c26337bf-c9ad-4e60-9dc3-18be22e703a8 tempest-VolumesTestJSON-1783746482 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:47:46 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-c26337bf-c9ad-4e60-9dc3-18be22e703a8 tempest-VolumesTestJSON-1783746482 None] Deleted volume successfully. Apr 25 15:47:46 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c26337bf-c9ad-4e60-9dc3-18be22e703a8 tempest-VolumesTestJSON-1783746482 None] Lock "cinder-ce4b26c8-d2c6-40f7-9acd-412651fe5e03-delete_volume" released by "delete_volume" :: held 2.270s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:47:51 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:47:51 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] Flow 'volume_create_manager' (88dac014-c12b-4c56-acc9-fa393a03a694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:47:52 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78a6ec4b-95fa-424e-9e9e-e3b61b4c53e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:52 devstack cinder-volume[81828]: INFO cinder.volume.manager [req-389b6287-4858-48aa-978d-7d669fdf1868 req-980524ae-028c-473d-9d2a-97790ac5978f tempest-DeleteServersTestJSON-997495508 None] Terminate volume connection completed successfully. Apr 25 15:47:52 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-389b6287-4858-48aa-978d-7d669fdf1868 req-980524ae-028c-473d-9d2a-97790ac5978f tempest-DeleteServersTestJSON-997495508 None] Deleting attachment ed0f1bb2-68ef-4bd4-b480-2c549befb26a. {{(pid=81828) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 25 15:47:52 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78a6ec4b-95fa-424e-9e9e-e3b61b4c53e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-114154498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c133976-dc67-47d4-b1e8-dc68fb41f2ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a00bf5c93f4d6c82e04d59e59d2f2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:52Z,use_quota=True,user_id='7977815c8f4c449da3b2c61ac8d73c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:52 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86633ffa-0bd7-4723-81cc-992fab8f11cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:52 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86633ffa-0bd7-4723-81cc-992fab8f11cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:52 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f4d4a61-0d76-43d2-988a-4cd41a9eeba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:52 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f4d4a61-0d76-43d2-988a-4cd41a9eeba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c133976-dc67-47d4-b1e8-dc68fb41f2ca', 'volume_name': 'volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:52 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (568557fc-b512-4eae-961a-1d76284312f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:52 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (568557fc-b512-4eae-961a-1d76284312f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:52 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b16b7f4-5250-4aa4-9f7f-2f0b64cebfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:52 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] Volume 8c133976-dc67-47d4-b1e8-dc68fb41f2ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca', 'volume_size': 1} Apr 25 15:47:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:47:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:47:52 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-114154498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c133976-dc67-47d4-b1e8-dc68fb41f2ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a00bf5c93f4d6c82e04d59e59d2f2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:47:52Z,use_quota=True,user_id='7977815c8f4c449da3b2c61ac8d73c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:47:52 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] Creating volume 8c133976-dc67-47d4-b1e8-dc68fb41f2ca {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:47:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:47:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:47:52 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:47:52 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:47:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:47:52 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:47:52 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:47:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:52 devstack sudo[83404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca 1073741824 Apr 25 15:47:52 devstack sudo[83404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:52 devstack sudo[83404]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca 1073741824" returned: 0 in 0.799s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:52 devstack sudo[83413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca Apr 25 15:47:52 devstack sudo[83413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:53 devstack sudo[83413]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca" returned: 0 in 0.583s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:53 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:47:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.443s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:47:53 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b16b7f4-5250-4aa4-9f7f-2f0b64cebfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:53 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907d3167-f5d9-489d-a713-68ffc5ab0895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:47:53 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] Volume volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca (8c133976-dc67-47d4-b1e8-dc68fb41f2ca): created successfully Apr 25 15:47:53 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907d3167-f5d9-489d-a713-68ffc5ab0895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:47:53 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] Flow 'volume_create_manager' (88dac014-c12b-4c56-acc9-fa393a03a694) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:47:53 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-d7f8a72c-f192-420a-af49-0cd71ef50e72 tempest-SnapshotsActionsTest-549497535 None] Created volume successfully. Apr 25 15:47:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-dacb7886-5a53-426d-8e20-abe179c280bf tempest-SnapshotsActionsTest-549497535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:47:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-dacb7886-5a53-426d-8e20-abe179c280bf tempest-SnapshotsActionsTest-549497535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:47:54 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-dacb7886-5a53-426d-8e20-abe179c280bf tempest-SnapshotsActionsTest-549497535 None] Creating offline snapshot acdc3b37-4504-410b-8ae7-f40c04851869 of volume 8c133976-dc67-47d4-b1e8-dc68fb41f2ca {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 15:47:54 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd6b0d5-6a52-47e4-91e6-5dc17278e24f]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:47:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-dacb7886-5a53-426d-8e20-abe179c280bf tempest-SnapshotsActionsTest-549497535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:54 devstack sudo[83417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca Apr 25 15:47:54 devstack sudo[83417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:54 devstack sudo[83417]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-dacb7886-5a53-426d-8e20-abe179c280bf tempest-SnapshotsActionsTest-549497535 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca" returned: 0 in 0.583s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-dacb7886-5a53-426d-8e20-abe179c280bf tempest-SnapshotsActionsTest-549497535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:54 devstack sudo[83423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 1G Apr 25 15:47:54 devstack sudo[83423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:55 devstack sudo[83423]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-dacb7886-5a53-426d-8e20-abe179c280bf tempest-SnapshotsActionsTest-549497535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 1G" returned: 0 in 0.627s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-dacb7886-5a53-426d-8e20-abe179c280bf tempest-SnapshotsActionsTest-549497535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:55 devstack sudo[83428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 Apr 25 15:47:55 devstack sudo[83428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:55 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-99a95d78-0d38-42b0-9ff5-c4f4595f22c8 tempest-DeleteServersTestJSON-997495508 None] Acquiring lock "cinder-f36a306a-2b34-4be0-a78d-0b2198713200-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:47:55 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-99a95d78-0d38-42b0-9ff5-c4f4595f22c8 tempest-DeleteServersTestJSON-997495508 None] Lock "cinder-f36a306a-2b34-4be0-a78d-0b2198713200-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:47:55 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-99a95d78-0d38-42b0-9ff5-c4f4595f22c8 tempest-DeleteServersTestJSON-997495508 None] Acquiring lock "cinder-quobyte-f36a306a-2b34-4be0-a78d-0b2198713200" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:47:56 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-99a95d78-0d38-42b0-9ff5-c4f4595f22c8 tempest-DeleteServersTestJSON-997495508 None] Lock "cinder-quobyte-f36a306a-2b34-4be0-a78d-0b2198713200" acquired by "delete_volume" :: waited 0.019s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:47:56 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b0e723-6d13-4c3b-bbad-c91bd4677f4a]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:47:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-99a95d78-0d38-42b0-9ff5-c4f4595f22c8 tempest-DeleteServersTestJSON-997495508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f36a306a-2b34-4be0-a78d-0b2198713200 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:56 devstack sudo[83430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f36a306a-2b34-4be0-a78d-0b2198713200 Apr 25 15:47:56 devstack sudo[83430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:56 devstack sudo[83428]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-dacb7886-5a53-426d-8e20-abe179c280bf tempest-SnapshotsActionsTest-549497535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869" returned: 0 in 0.661s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:56 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-dacb7886-5a53-426d-8e20-abe179c280bf tempest-SnapshotsActionsTest-549497535 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 is being set with open permissions: ugo+rw Apr 25 15:47:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-dacb7886-5a53-426d-8e20-abe179c280bf tempest-SnapshotsActionsTest-549497535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:56 devstack sudo[83435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 Apr 25 15:47:56 devstack sudo[83435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:56 devstack sudo[83430]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-99a95d78-0d38-42b0-9ff5-c4f4595f22c8 tempest-DeleteServersTestJSON-997495508 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f36a306a-2b34-4be0-a78d-0b2198713200" returned: 0 in 0.647s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-99a95d78-0d38-42b0-9ff5-c4f4595f22c8 tempest-DeleteServersTestJSON-997495508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f36a306a-2b34-4be0-a78d-0b2198713200 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:56 devstack sudo[83442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f36a306a-2b34-4be0-a78d-0b2198713200 Apr 25 15:47:56 devstack sudo[83442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:56 devstack sudo[83435]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-dacb7886-5a53-426d-8e20-abe179c280bf tempest-SnapshotsActionsTest-549497535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869" returned: 0 in 0.504s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-dacb7886-5a53-426d-8e20-abe179c280bf tempest-SnapshotsActionsTest-549497535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:56 devstack sudo[83445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.info Apr 25 15:47:56 devstack sudo[83445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:57 devstack sudo[83442]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-99a95d78-0d38-42b0-9ff5-c4f4595f22c8 tempest-DeleteServersTestJSON-997495508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f36a306a-2b34-4be0-a78d-0b2198713200" returned: 0 in 0.677s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:57 devstack sudo[83445]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-dacb7886-5a53-426d-8e20-abe179c280bf tempest-SnapshotsActionsTest-549497535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.info" returned: 0 in 0.599s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:57 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-dacb7886-5a53-426d-8e20-abe179c280bf tempest-SnapshotsActionsTest-549497535 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.info is being set with open permissions: ugo+rw Apr 25 15:47:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-dacb7886-5a53-426d-8e20-abe179c280bf tempest-SnapshotsActionsTest-549497535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:57 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-99a95d78-0d38-42b0-9ff5-c4f4595f22c8 tempest-DeleteServersTestJSON-997495508 None] Lock "cinder-quobyte-f36a306a-2b34-4be0-a78d-0b2198713200" released by "delete_volume" :: held 1.420s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:47:57 devstack sudo[83449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.info Apr 25 15:47:57 devstack sudo[83449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:57 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-99a95d78-0d38-42b0-9ff5-c4f4595f22c8 tempest-DeleteServersTestJSON-997495508 None] Created reservations ['a19ac14a-37b4-4519-bf10-1ad3957d6bc2', 'a8bc543c-5519-425e-80de-2230b5a8cd6a', 'f9577270-4436-499b-9945-b0d61deafcb5', '82cd9b73-9163-429d-bdea-f9bbc4ed0a5c'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:47:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-99a95d78-0d38-42b0-9ff5-c4f4595f22c8 tempest-DeleteServersTestJSON-997495508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:47:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-99a95d78-0d38-42b0-9ff5-c4f4595f22c8 tempest-DeleteServersTestJSON-997495508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:47:57 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-99a95d78-0d38-42b0-9ff5-c4f4595f22c8 tempest-DeleteServersTestJSON-997495508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:47:57 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-99a95d78-0d38-42b0-9ff5-c4f4595f22c8 tempest-DeleteServersTestJSON-997495508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:47:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-99a95d78-0d38-42b0-9ff5-c4f4595f22c8 tempest-DeleteServersTestJSON-997495508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:47:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-99a95d78-0d38-42b0-9ff5-c4f4595f22c8 tempest-DeleteServersTestJSON-997495508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:57 devstack sudo[83451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:47:57 devstack sudo[83451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:47:58 devstack sudo[83451]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-99a95d78-0d38-42b0-9ff5-c4f4595f22c8 tempest-DeleteServersTestJSON-997495508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.626s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:58 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-99a95d78-0d38-42b0-9ff5-c4f4595f22c8 tempest-DeleteServersTestJSON-997495508 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:47:58 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-99a95d78-0d38-42b0-9ff5-c4f4595f22c8 tempest-DeleteServersTestJSON-997495508 None] Deleted volume successfully. Apr 25 15:47:58 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-99a95d78-0d38-42b0-9ff5-c4f4595f22c8 tempest-DeleteServersTestJSON-997495508 None] Lock "cinder-f36a306a-2b34-4be0-a78d-0b2198713200-delete_volume" released by "delete_volume" :: held 2.305s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:47:58 devstack sudo[83449]: pam_unix(sudo:session): session closed for user root Apr 25 15:47:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-dacb7886-5a53-426d-8e20-abe179c280bf tempest-SnapshotsActionsTest-549497535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.info" returned: 0 in 0.841s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:47:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-dacb7886-5a53-426d-8e20-abe179c280bf tempest-SnapshotsActionsTest-549497535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.916s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:47:58 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-dacb7886-5a53-426d-8e20-abe179c280bf tempest-SnapshotsActionsTest-549497535 None] Create snapshot completed successfully Apr 25 15:47:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-57a80776-9639-4045-a1f1-37dfee6e6920 tempest-SnapshotsActionsTest-549497535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:47:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-57a80776-9639-4045-a1f1-37dfee6e6920 tempest-SnapshotsActionsTest-549497535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:47:59 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-57a80776-9639-4045-a1f1-37dfee6e6920 tempest-SnapshotsActionsTest-549497535 None] Creating offline snapshot 5eab1fea-7ad1-4cef-9fc0-4b133d527f09 of volume 8c133976-dc67-47d4-b1e8-dc68fb41f2ca {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 15:47:59 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1905c1-5421-4fcd-8b3f-d458bcb6ab88]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:47:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-57a80776-9639-4045-a1f1-37dfee6e6920 tempest-SnapshotsActionsTest-549497535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:47:59 devstack sudo[83467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 Apr 25 15:47:59 devstack sudo[83467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:00 devstack sudo[83467]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-57a80776-9639-4045-a1f1-37dfee6e6920 tempest-SnapshotsActionsTest-549497535 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869" returned: 0 in 0.709s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-57a80776-9639-4045-a1f1-37dfee6e6920 tempest-SnapshotsActionsTest-549497535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:48:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-57a80776-9639-4045-a1f1-37dfee6e6920 tempest-SnapshotsActionsTest-549497535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.5eab1fea-7ad1-4cef-9fc0-4b133d527f09 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:00 devstack sudo[83478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.5eab1fea-7ad1-4cef-9fc0-4b133d527f09 1G Apr 25 15:48:00 devstack sudo[83478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:00 devstack cinder-volume[81828]: DEBUG oslo_service.periodic_task [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81828) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 25 15:48:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:48:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:48:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:48:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:48:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:48:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:00 devstack sudo[83481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:48:00 devstack sudo[83481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:00 devstack sudo[83481]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.569s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:00 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:48:00 devstack sudo[83478]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-57a80776-9639-4045-a1f1-37dfee6e6920 tempest-SnapshotsActionsTest-549497535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.5eab1fea-7ad1-4cef-9fc0-4b133d527f09 1G" returned: 0 in 0.816s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-57a80776-9639-4045-a1f1-37dfee6e6920 tempest-SnapshotsActionsTest-549497535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.5eab1fea-7ad1-4cef-9fc0-4b133d527f09 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:00 devstack sudo[83487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.5eab1fea-7ad1-4cef-9fc0-4b133d527f09 Apr 25 15:48:00 devstack sudo[83487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:01 devstack sudo[83487]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-57a80776-9639-4045-a1f1-37dfee6e6920 tempest-SnapshotsActionsTest-549497535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.5eab1fea-7ad1-4cef-9fc0-4b133d527f09" returned: 0 in 0.714s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:01 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-57a80776-9639-4045-a1f1-37dfee6e6920 tempest-SnapshotsActionsTest-549497535 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.5eab1fea-7ad1-4cef-9fc0-4b133d527f09 is being set with open permissions: ugo+rw Apr 25 15:48:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-57a80776-9639-4045-a1f1-37dfee6e6920 tempest-SnapshotsActionsTest-549497535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.5eab1fea-7ad1-4cef-9fc0-4b133d527f09 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:01 devstack sudo[83493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.5eab1fea-7ad1-4cef-9fc0-4b133d527f09 Apr 25 15:48:01 devstack sudo[83493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:02 devstack sudo[83493]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-57a80776-9639-4045-a1f1-37dfee6e6920 tempest-SnapshotsActionsTest-549497535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.5eab1fea-7ad1-4cef-9fc0-4b133d527f09" returned: 0 in 0.627s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-57a80776-9639-4045-a1f1-37dfee6e6920 tempest-SnapshotsActionsTest-549497535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.024s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:48:02 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-57a80776-9639-4045-a1f1-37dfee6e6920 tempest-SnapshotsActionsTest-549497535 None] Create snapshot completed successfully Apr 25 15:48:03 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3705bd3e-b990-4675-a520-dccaa1898f51 tempest-SnapshotsActionsTest-997544256 None] Acquiring lock "cinder-5eab1fea-7ad1-4cef-9fc0-4b133d527f09-delete_snapshot" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:48:03 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3705bd3e-b990-4675-a520-dccaa1898f51 tempest-SnapshotsActionsTest-997544256 None] Lock "cinder-5eab1fea-7ad1-4cef-9fc0-4b133d527f09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:48:03 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3705bd3e-b990-4675-a520-dccaa1898f51 tempest-SnapshotsActionsTest-997544256 None] Acquiring lock "cinder-quobyte-8c133976-dc67-47d4-b1e8-dc68fb41f2ca" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:48:03 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3705bd3e-b990-4675-a520-dccaa1898f51 tempest-SnapshotsActionsTest-997544256 None] Lock "cinder-quobyte-8c133976-dc67-47d4-b1e8-dc68fb41f2ca" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:48:03 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3705bd3e-b990-4675-a520-dccaa1898f51 tempest-SnapshotsActionsTest-997544256 None] Acquiring lock "cinder-quobyte-5eab1fea-7ad1-4cef-9fc0-4b133d527f09" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:48:03 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3705bd3e-b990-4675-a520-dccaa1898f51 tempest-SnapshotsActionsTest-997544256 None] Lock "cinder-quobyte-5eab1fea-7ad1-4cef-9fc0-4b133d527f09" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:48:03 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-3705bd3e-b990-4675-a520-dccaa1898f51 tempest-SnapshotsActionsTest-997544256 None] Deleting offline snapshot 5eab1fea-7ad1-4cef-9fc0-4b133d527f09 of volume 8c133976-dc67-47d4-b1e8-dc68fb41f2ca {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 15:48:03 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-3705bd3e-b990-4675-a520-dccaa1898f51 tempest-SnapshotsActionsTest-997544256 None] snapshot_file for this snap is: volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.5eab1fea-7ad1-4cef-9fc0-4b133d527f09 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 15:48:03 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa10350d-9c39-42bb-8e2d-7c24be4ccd5f]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:48:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3705bd3e-b990-4675-a520-dccaa1898f51 tempest-SnapshotsActionsTest-997544256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.5eab1fea-7ad1-4cef-9fc0-4b133d527f09 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:03 devstack sudo[83502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.5eab1fea-7ad1-4cef-9fc0-4b133d527f09 Apr 25 15:48:03 devstack sudo[83502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:04 devstack sudo[83502]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3705bd3e-b990-4675-a520-dccaa1898f51 tempest-SnapshotsActionsTest-997544256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.5eab1fea-7ad1-4cef-9fc0-4b133d527f09" returned: 0 in 0.685s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:04 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-3705bd3e-b990-4675-a520-dccaa1898f51 tempest-SnapshotsActionsTest-997544256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:48:04 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1a82b9-6fe7-43be-a17e-24bad071541c]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:48:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3705bd3e-b990-4675-a520-dccaa1898f51 tempest-SnapshotsActionsTest-997544256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:04 devstack sudo[83507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 Apr 25 15:48:04 devstack sudo[83507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:05 devstack sudo[83507]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3705bd3e-b990-4675-a520-dccaa1898f51 tempest-SnapshotsActionsTest-997544256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869" returned: 0 in 0.654s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:05 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-3705bd3e-b990-4675-a520-dccaa1898f51 tempest-SnapshotsActionsTest-997544256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:48:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3705bd3e-b990-4675-a520-dccaa1898f51 tempest-SnapshotsActionsTest-997544256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.5eab1fea-7ad1-4cef-9fc0-4b133d527f09 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:05 devstack sudo[83515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.5eab1fea-7ad1-4cef-9fc0-4b133d527f09 Apr 25 15:48:05 devstack sudo[83515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:05 devstack sudo[83515]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3705bd3e-b990-4675-a520-dccaa1898f51 tempest-SnapshotsActionsTest-997544256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.5eab1fea-7ad1-4cef-9fc0-4b133d527f09" returned: 0 in 0.905s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3705bd3e-b990-4675-a520-dccaa1898f51 tempest-SnapshotsActionsTest-997544256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.5eab1fea-7ad1-4cef-9fc0-4b133d527f09 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:06 devstack sudo[83531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.5eab1fea-7ad1-4cef-9fc0-4b133d527f09 Apr 25 15:48:06 devstack sudo[83531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:06 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:48:06 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] Flow 'volume_create_manager' (34cc83cc-cb62-4679-b0e5-852f9dd50ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:48:06 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a76639-fbf5-431d-a9a8-0d188081b5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:48:06 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08a76639-fbf5-431d-a9a8-0d188081b5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-171942128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46253bc7-e690-481f-b4e2-db8048dba9d3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c561af8d4ab40ff95a84918c60686a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:48:06Z,use_quota=True,user_id='4e0bf0e9834f4d219a8f3e761d71522c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:48:06 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df003b85-dff8-44e2-aa3f-665bdd6589ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:48:06 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df003b85-dff8-44e2-aa3f-665bdd6589ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:48:06 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f8f0b2c-19b9-4400-88f4-41919ef82c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:48:06 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f8f0b2c-19b9-4400-88f4-41919ef82c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46253bc7-e690-481f-b4e2-db8048dba9d3', 'volume_name': 'volume-46253bc7-e690-481f-b4e2-db8048dba9d3', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:48:06 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee6d6378-9d2f-4e61-85cb-0d8e823b1b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:48:06 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee6d6378-9d2f-4e61-85cb-0d8e823b1b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:48:06 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0743a576-773b-4b12-83ae-d5e6d3f431a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:48:06 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] Volume 46253bc7-e690-481f-b4e2-db8048dba9d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46253bc7-e690-481f-b4e2-db8048dba9d3', 'volume_size': 1} Apr 25 15:48:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:48:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:48:06 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:48:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-171942128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46253bc7-e690-481f-b4e2-db8048dba9d3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0c561af8d4ab40ff95a84918c60686a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:48:06Z,use_quota=True,user_id='4e0bf0e9834f4d219a8f3e761d71522c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:48:06 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] Creating volume 46253bc7-e690-481f-b4e2-db8048dba9d3 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:48:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:48:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:48:06 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:48:06 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:48:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.087s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:48:06 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:48:06 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:48:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-46253bc7-e690-481f-b4e2-db8048dba9d3 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:06 devstack sudo[83548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-46253bc7-e690-481f-b4e2-db8048dba9d3 1073741824 Apr 25 15:48:06 devstack sudo[83548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:06 devstack sudo[83531]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3705bd3e-b990-4675-a520-dccaa1898f51 tempest-SnapshotsActionsTest-997544256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.5eab1fea-7ad1-4cef-9fc0-4b133d527f09" returned: 0 in 0.997s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:07 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3705bd3e-b990-4675-a520-dccaa1898f51 tempest-SnapshotsActionsTest-997544256 None] Lock "cinder-quobyte-5eab1fea-7ad1-4cef-9fc0-4b133d527f09" released by "_delete_snapshot" :: held 3.403s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:48:07 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3705bd3e-b990-4675-a520-dccaa1898f51 tempest-SnapshotsActionsTest-997544256 None] Lock "cinder-quobyte-8c133976-dc67-47d4-b1e8-dc68fb41f2ca" released by "delete_snapshot" :: held 3.440s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:48:07 devstack cinder-volume[81828]: WARNING cinder.quota [None req-3705bd3e-b990-4675-a520-dccaa1898f51 tempest-SnapshotsActionsTest-997544256 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 25 15:48:07 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-3705bd3e-b990-4675-a520-dccaa1898f51 tempest-SnapshotsActionsTest-997544256 None] Created reservations ['dd0cc169-7910-4fc7-8774-d6db4a911bea', 'c3cbb46b-59d7-4951-9b08-1504bc26076a', 'b94f1c4d-bc45-4c82-8f70-2c2896d426ca', 'a5fa58be-5a9d-43d3-bbdd-b6ff4f3ad706'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:48:07 devstack sudo[83548]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-46253bc7-e690-481f-b4e2-db8048dba9d3 1073741824" returned: 0 in 0.967s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-46253bc7-e690-481f-b4e2-db8048dba9d3 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:07 devstack sudo[83570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-46253bc7-e690-481f-b4e2-db8048dba9d3 Apr 25 15:48:07 devstack sudo[83570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:07 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-3705bd3e-b990-4675-a520-dccaa1898f51 tempest-SnapshotsActionsTest-997544256 None] Delete snapshot completed successfully. Apr 25 15:48:07 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3705bd3e-b990-4675-a520-dccaa1898f51 tempest-SnapshotsActionsTest-997544256 None] Lock "cinder-5eab1fea-7ad1-4cef-9fc0-4b133d527f09-delete_snapshot" released by "delete_snapshot" :: held 3.885s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:48:08 devstack sudo[83570]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-46253bc7-e690-481f-b4e2-db8048dba9d3" returned: 0 in 0.686s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:08 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] <== create_volume: return (1815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:48:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:48:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0743a576-773b-4b12-83ae-d5e6d3f431a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46253bc7-e690-481f-b4e2-db8048dba9d3', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:48:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847527a3-d924-4732-a110-98a1253f1b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:48:08 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] Volume volume-46253bc7-e690-481f-b4e2-db8048dba9d3 (46253bc7-e690-481f-b4e2-db8048dba9d3): created successfully Apr 25 15:48:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (847527a3-d924-4732-a110-98a1253f1b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:48:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] Flow 'volume_create_manager' (34cc83cc-cb62-4679-b0e5-852f9dd50ea8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:48:08 devstack cinder-volume[81828]: INFO cinder.volume.manager [req-2d142896-e3e8-4c10-abf5-eeeeadb9b33f req-43342978-3a25-43d1-8383-0db06201a529 tempest-VolumesGetTestJSON-1540082494 None] Created volume successfully. Apr 25 15:48:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-10a1dd5a-1de7-4e11-8028-5f73c31df52e tempest-SnapshotsActionsTest-549497535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:48:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-10a1dd5a-1de7-4e11-8028-5f73c31df52e tempest-SnapshotsActionsTest-549497535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:48:08 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-10a1dd5a-1de7-4e11-8028-5f73c31df52e tempest-SnapshotsActionsTest-549497535 None] Creating offline snapshot fd9d2c7a-13ad-459e-bbbc-3cd3ff2a2729 of volume 8c133976-dc67-47d4-b1e8-dc68fb41f2ca {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 15:48:08 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[7275489f-223f-4d25-899c-0b6a64947722]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:48:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-10a1dd5a-1de7-4e11-8028-5f73c31df52e tempest-SnapshotsActionsTest-549497535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:08 devstack sudo[83609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 Apr 25 15:48:08 devstack sudo[83609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:09 devstack cinder-volume[81828]: DEBUG cinder.coordination [req-e23af723-9fe5-4b86-85a7-3d2ec426ea24 req-af81ce18-2b74-4377-8790-0eda09fd72b0 tempest-VolumesGetTestJSON-1540082494 None] Acquiring lock "cinder-46253bc7-e690-481f-b4e2-db8048dba9d3-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:48:09 devstack cinder-volume[81828]: DEBUG cinder.coordination [req-e23af723-9fe5-4b86-85a7-3d2ec426ea24 req-af81ce18-2b74-4377-8790-0eda09fd72b0 tempest-VolumesGetTestJSON-1540082494 None] Lock "cinder-46253bc7-e690-481f-b4e2-db8048dba9d3-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:48:09 devstack cinder-volume[81828]: DEBUG cinder.coordination [req-e23af723-9fe5-4b86-85a7-3d2ec426ea24 req-af81ce18-2b74-4377-8790-0eda09fd72b0 tempest-VolumesGetTestJSON-1540082494 None] Acquiring lock "cinder-quobyte-46253bc7-e690-481f-b4e2-db8048dba9d3" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:48:09 devstack cinder-volume[81828]: DEBUG cinder.coordination [req-e23af723-9fe5-4b86-85a7-3d2ec426ea24 req-af81ce18-2b74-4377-8790-0eda09fd72b0 tempest-VolumesGetTestJSON-1540082494 None] Lock "cinder-quobyte-46253bc7-e690-481f-b4e2-db8048dba9d3" acquired by "delete_volume" :: waited 0.023s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:48:09 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a790d71-568c-4ae3-ae1c-8ac62fb7acc6]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:48:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-e23af723-9fe5-4b86-85a7-3d2ec426ea24 req-af81ce18-2b74-4377-8790-0eda09fd72b0 tempest-VolumesGetTestJSON-1540082494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-46253bc7-e690-481f-b4e2-db8048dba9d3 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:09 devstack sudo[83612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-46253bc7-e690-481f-b4e2-db8048dba9d3 Apr 25 15:48:09 devstack sudo[83612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:09 devstack sudo[83609]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-10a1dd5a-1de7-4e11-8028-5f73c31df52e tempest-SnapshotsActionsTest-549497535 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869" returned: 0 in 0.973s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:09 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-10a1dd5a-1de7-4e11-8028-5f73c31df52e tempest-SnapshotsActionsTest-549497535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:48:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-10a1dd5a-1de7-4e11-8028-5f73c31df52e tempest-SnapshotsActionsTest-549497535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.fd9d2c7a-13ad-459e-bbbc-3cd3ff2a2729 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:09 devstack sudo[83617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.fd9d2c7a-13ad-459e-bbbc-3cd3ff2a2729 1G Apr 25 15:48:09 devstack sudo[83617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:10 devstack sudo[83612]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-e23af723-9fe5-4b86-85a7-3d2ec426ea24 req-af81ce18-2b74-4377-8790-0eda09fd72b0 tempest-VolumesGetTestJSON-1540082494 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-46253bc7-e690-481f-b4e2-db8048dba9d3" returned: 0 in 0.670s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-e23af723-9fe5-4b86-85a7-3d2ec426ea24 req-af81ce18-2b74-4377-8790-0eda09fd72b0 tempest-VolumesGetTestJSON-1540082494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-46253bc7-e690-481f-b4e2-db8048dba9d3 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:10 devstack sudo[83622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-46253bc7-e690-481f-b4e2-db8048dba9d3 Apr 25 15:48:10 devstack sudo[83622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:10 devstack sudo[83617]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-10a1dd5a-1de7-4e11-8028-5f73c31df52e tempest-SnapshotsActionsTest-549497535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.fd9d2c7a-13ad-459e-bbbc-3cd3ff2a2729 1G" returned: 0 in 0.886s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-10a1dd5a-1de7-4e11-8028-5f73c31df52e tempest-SnapshotsActionsTest-549497535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.fd9d2c7a-13ad-459e-bbbc-3cd3ff2a2729 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:10 devstack sudo[83627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.fd9d2c7a-13ad-459e-bbbc-3cd3ff2a2729 Apr 25 15:48:10 devstack sudo[83627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:10 devstack sudo[83622]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-e23af723-9fe5-4b86-85a7-3d2ec426ea24 req-af81ce18-2b74-4377-8790-0eda09fd72b0 tempest-VolumesGetTestJSON-1540082494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-46253bc7-e690-481f-b4e2-db8048dba9d3" returned: 0 in 0.737s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:10 devstack cinder-volume[81828]: DEBUG cinder.coordination [req-e23af723-9fe5-4b86-85a7-3d2ec426ea24 req-af81ce18-2b74-4377-8790-0eda09fd72b0 tempest-VolumesGetTestJSON-1540082494 None] Lock "cinder-quobyte-46253bc7-e690-481f-b4e2-db8048dba9d3" released by "delete_volume" :: held 1.456s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:48:10 devstack cinder-volume[81828]: DEBUG cinder.quota [req-e23af723-9fe5-4b86-85a7-3d2ec426ea24 req-af81ce18-2b74-4377-8790-0eda09fd72b0 tempest-VolumesGetTestJSON-1540082494 None] Created reservations ['38b8b3fb-9210-4a0e-a511-778a1c11e217', '892399f6-8dc1-49c9-a27d-efc290b509e8', '955fc373-3941-4746-b739-8c6327b7b447', '194ffef1-bb58-46cc-814b-8144e73a41f2'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:48:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-e23af723-9fe5-4b86-85a7-3d2ec426ea24 req-af81ce18-2b74-4377-8790-0eda09fd72b0 tempest-VolumesGetTestJSON-1540082494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:48:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-e23af723-9fe5-4b86-85a7-3d2ec426ea24 req-af81ce18-2b74-4377-8790-0eda09fd72b0 tempest-VolumesGetTestJSON-1540082494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:48:11 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [req-e23af723-9fe5-4b86-85a7-3d2ec426ea24 req-af81ce18-2b74-4377-8790-0eda09fd72b0 tempest-VolumesGetTestJSON-1540082494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:48:11 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [req-e23af723-9fe5-4b86-85a7-3d2ec426ea24 req-af81ce18-2b74-4377-8790-0eda09fd72b0 tempest-VolumesGetTestJSON-1540082494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:48:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-e23af723-9fe5-4b86-85a7-3d2ec426ea24 req-af81ce18-2b74-4377-8790-0eda09fd72b0 tempest-VolumesGetTestJSON-1540082494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:48:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-e23af723-9fe5-4b86-85a7-3d2ec426ea24 req-af81ce18-2b74-4377-8790-0eda09fd72b0 tempest-VolumesGetTestJSON-1540082494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:11 devstack sudo[83631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:48:11 devstack sudo[83631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:11 devstack sudo[83627]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-10a1dd5a-1de7-4e11-8028-5f73c31df52e tempest-SnapshotsActionsTest-549497535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.fd9d2c7a-13ad-459e-bbbc-3cd3ff2a2729" returned: 0 in 1.350s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:11 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-10a1dd5a-1de7-4e11-8028-5f73c31df52e tempest-SnapshotsActionsTest-549497535 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.fd9d2c7a-13ad-459e-bbbc-3cd3ff2a2729 is being set with open permissions: ugo+rw Apr 25 15:48:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-10a1dd5a-1de7-4e11-8028-5f73c31df52e tempest-SnapshotsActionsTest-549497535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.fd9d2c7a-13ad-459e-bbbc-3cd3ff2a2729 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:11 devstack sudo[83636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.fd9d2c7a-13ad-459e-bbbc-3cd3ff2a2729 Apr 25 15:48:11 devstack sudo[83636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:12 devstack sudo[83631]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-e23af723-9fe5-4b86-85a7-3d2ec426ea24 req-af81ce18-2b74-4377-8790-0eda09fd72b0 tempest-VolumesGetTestJSON-1540082494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 1.138s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:12 devstack cinder-volume[81828]: DEBUG cinder.manager [req-e23af723-9fe5-4b86-85a7-3d2ec426ea24 req-af81ce18-2b74-4377-8790-0eda09fd72b0 tempest-VolumesGetTestJSON-1540082494 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:48:12 devstack cinder-volume[81828]: INFO cinder.volume.manager [req-e23af723-9fe5-4b86-85a7-3d2ec426ea24 req-af81ce18-2b74-4377-8790-0eda09fd72b0 tempest-VolumesGetTestJSON-1540082494 None] Deleted volume successfully. Apr 25 15:48:12 devstack cinder-volume[81828]: DEBUG cinder.coordination [req-e23af723-9fe5-4b86-85a7-3d2ec426ea24 req-af81ce18-2b74-4377-8790-0eda09fd72b0 tempest-VolumesGetTestJSON-1540082494 None] Lock "cinder-46253bc7-e690-481f-b4e2-db8048dba9d3-delete_volume" released by "delete_volume" :: held 2.948s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:48:13 devstack sudo[83636]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-10a1dd5a-1de7-4e11-8028-5f73c31df52e tempest-SnapshotsActionsTest-549497535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.fd9d2c7a-13ad-459e-bbbc-3cd3ff2a2729" returned: 0 in 1.211s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:13 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:SELECT=66,cinder:UPDATE=78,cinder:DELETE=8,cinder:INSERT=18 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:48:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-10a1dd5a-1de7-4e11-8028-5f73c31df52e tempest-SnapshotsActionsTest-549497535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.635s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:48:13 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-10a1dd5a-1de7-4e11-8028-5f73c31df52e tempest-SnapshotsActionsTest-549497535 None] Create snapshot completed successfully Apr 25 15:48:13 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b4ec8baf-2c67-449d-8708-9b3d13a6f567 tempest-SnapshotsActionsTest-997544256 None] Acquiring lock "cinder-fd9d2c7a-13ad-459e-bbbc-3cd3ff2a2729-delete_snapshot" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:48:13 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b4ec8baf-2c67-449d-8708-9b3d13a6f567 tempest-SnapshotsActionsTest-997544256 None] Lock "cinder-fd9d2c7a-13ad-459e-bbbc-3cd3ff2a2729-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:48:13 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b4ec8baf-2c67-449d-8708-9b3d13a6f567 tempest-SnapshotsActionsTest-997544256 None] Acquiring lock "cinder-quobyte-8c133976-dc67-47d4-b1e8-dc68fb41f2ca" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:48:13 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b4ec8baf-2c67-449d-8708-9b3d13a6f567 tempest-SnapshotsActionsTest-997544256 None] Lock "cinder-quobyte-8c133976-dc67-47d4-b1e8-dc68fb41f2ca" acquired by "delete_snapshot" :: waited 0.048s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:48:13 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b4ec8baf-2c67-449d-8708-9b3d13a6f567 tempest-SnapshotsActionsTest-997544256 None] Acquiring lock "cinder-quobyte-fd9d2c7a-13ad-459e-bbbc-3cd3ff2a2729" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:48:13 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b4ec8baf-2c67-449d-8708-9b3d13a6f567 tempest-SnapshotsActionsTest-997544256 None] Lock "cinder-quobyte-fd9d2c7a-13ad-459e-bbbc-3cd3ff2a2729" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:48:13 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-b4ec8baf-2c67-449d-8708-9b3d13a6f567 tempest-SnapshotsActionsTest-997544256 None] Deleting offline snapshot fd9d2c7a-13ad-459e-bbbc-3cd3ff2a2729 of volume 8c133976-dc67-47d4-b1e8-dc68fb41f2ca {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 15:48:13 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-b4ec8baf-2c67-449d-8708-9b3d13a6f567 tempest-SnapshotsActionsTest-997544256 None] snapshot_file for this snap is: volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.fd9d2c7a-13ad-459e-bbbc-3cd3ff2a2729 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 15:48:14 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e663f7-8ecb-4f12-a687-91e3e97f0676]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:48:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4ec8baf-2c67-449d-8708-9b3d13a6f567 tempest-SnapshotsActionsTest-997544256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.fd9d2c7a-13ad-459e-bbbc-3cd3ff2a2729 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:14 devstack sudo[83643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.fd9d2c7a-13ad-459e-bbbc-3cd3ff2a2729 Apr 25 15:48:14 devstack sudo[83643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:14 devstack sudo[83643]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4ec8baf-2c67-449d-8708-9b3d13a6f567 tempest-SnapshotsActionsTest-997544256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.fd9d2c7a-13ad-459e-bbbc-3cd3ff2a2729" returned: 0 in 0.896s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:14 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-b4ec8baf-2c67-449d-8708-9b3d13a6f567 tempest-SnapshotsActionsTest-997544256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:48:14 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ff8830-f0af-41c0-8b46-67820c1d92d0]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:48:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4ec8baf-2c67-449d-8708-9b3d13a6f567 tempest-SnapshotsActionsTest-997544256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:15 devstack sudo[83648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 Apr 25 15:48:15 devstack sudo[83648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:16 devstack sudo[83648]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4ec8baf-2c67-449d-8708-9b3d13a6f567 tempest-SnapshotsActionsTest-997544256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869" returned: 0 in 1.132s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-b4ec8baf-2c67-449d-8708-9b3d13a6f567 tempest-SnapshotsActionsTest-997544256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:48:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4ec8baf-2c67-449d-8708-9b3d13a6f567 tempest-SnapshotsActionsTest-997544256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.fd9d2c7a-13ad-459e-bbbc-3cd3ff2a2729 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:16 devstack sudo[83672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.fd9d2c7a-13ad-459e-bbbc-3cd3ff2a2729 Apr 25 15:48:16 devstack sudo[83672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:17 devstack sudo[83672]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4ec8baf-2c67-449d-8708-9b3d13a6f567 tempest-SnapshotsActionsTest-997544256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.fd9d2c7a-13ad-459e-bbbc-3cd3ff2a2729" returned: 0 in 1.336s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4ec8baf-2c67-449d-8708-9b3d13a6f567 tempest-SnapshotsActionsTest-997544256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.fd9d2c7a-13ad-459e-bbbc-3cd3ff2a2729 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:17 devstack sudo[83690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.fd9d2c7a-13ad-459e-bbbc-3cd3ff2a2729 Apr 25 15:48:17 devstack sudo[83690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:18 devstack sudo[83690]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4ec8baf-2c67-449d-8708-9b3d13a6f567 tempest-SnapshotsActionsTest-997544256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.fd9d2c7a-13ad-459e-bbbc-3cd3ff2a2729" returned: 0 in 0.653s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:18 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b4ec8baf-2c67-449d-8708-9b3d13a6f567 tempest-SnapshotsActionsTest-997544256 None] Lock "cinder-quobyte-fd9d2c7a-13ad-459e-bbbc-3cd3ff2a2729" released by "_delete_snapshot" :: held 4.175s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:48:18 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b4ec8baf-2c67-449d-8708-9b3d13a6f567 tempest-SnapshotsActionsTest-997544256 None] Lock "cinder-quobyte-8c133976-dc67-47d4-b1e8-dc68fb41f2ca" released by "delete_snapshot" :: held 4.220s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:48:18 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-b4ec8baf-2c67-449d-8708-9b3d13a6f567 tempest-SnapshotsActionsTest-997544256 None] Created reservations ['73dd7b4e-c96a-488a-b0ff-1107e863140f', 'dd83902b-5b36-4f11-b4ad-93679274ada1', '6b233e5f-2e87-43ef-83f4-ce56d45702c1', '2477484a-2d00-465b-b9b5-24de3b8f8a54'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:48:18 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-b4ec8baf-2c67-449d-8708-9b3d13a6f567 tempest-SnapshotsActionsTest-997544256 None] Delete snapshot completed successfully. Apr 25 15:48:18 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b4ec8baf-2c67-449d-8708-9b3d13a6f567 tempest-SnapshotsActionsTest-997544256 None] Lock "cinder-fd9d2c7a-13ad-459e-bbbc-3cd3ff2a2729-delete_snapshot" released by "delete_snapshot" :: held 4.460s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:48:18 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-04664e90-34c7-4b2a-b300-ad8021d289d3 tempest-GroupSnapshotsTest-536830151 None] Group tempest-GroupSnapshotsTest-Group-824534425: creating Apr 25 15:48:19 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-04664e90-34c7-4b2a-b300-ad8021d289d3 tempest-GroupSnapshotsTest-536830151 None] Group tempest-GroupSnapshotsTest-Group-824534425: created successfully Apr 25 15:48:19 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-04664e90-34c7-4b2a-b300-ad8021d289d3 tempest-GroupSnapshotsTest-536830151 None] Create group completed successfully. Apr 25 15:48:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e5c3b1fb-4605-43ff-8f99-6f1c6df86904 tempest-SnapshotsActionsTest-549497535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:48:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e5c3b1fb-4605-43ff-8f99-6f1c6df86904 tempest-SnapshotsActionsTest-549497535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:48:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-e5c3b1fb-4605-43ff-8f99-6f1c6df86904 tempest-SnapshotsActionsTest-549497535 None] Creating offline snapshot 8787e810-9e54-4a07-8a14-7e0626684b87 of volume 8c133976-dc67-47d4-b1e8-dc68fb41f2ca {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 15:48:19 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d96479-518e-4ae6-983b-a0ac5b2d78b4]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:48:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e5c3b1fb-4605-43ff-8f99-6f1c6df86904 tempest-SnapshotsActionsTest-549497535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:20 devstack sudo[83731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 Apr 25 15:48:20 devstack sudo[83731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:20 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:48:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] Flow 'volume_create_manager' (d59ff157-2ade-41a0-99f7-5586ba4a3291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:48:20 devstack sudo[83731]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d812e84-c306-4dd6-8e01-4313dc8f7ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:48:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e5c3b1fb-4605-43ff-8f99-6f1c6df86904 tempest-SnapshotsActionsTest-549497535 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869" returned: 0 in 0.720s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:20 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-e5c3b1fb-4605-43ff-8f99-6f1c6df86904 tempest-SnapshotsActionsTest-549497535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:48:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e5c3b1fb-4605-43ff-8f99-6f1c6df86904 tempest-SnapshotsActionsTest-549497535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.8787e810-9e54-4a07-8a14-7e0626684b87 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d812e84-c306-4dd6-8e01-4313dc8f7ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-236258127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=80cc7f32-d97a-4e7d-89cf-6f2fa8b1fb7d,host='devstack@QuobyteHD#QuobyteHD',id=e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fce156ffabb4b57aef047b587bf194d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:48:21Z,use_quota=True,user_id='aaefbbda6ecb422bb0daaaad82e2752a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ac6f5ca-6374-4179-866b-6b764d11a0a5),volume_type_id=2ac6f5ca-6374-4179-866b-6b764d11a0a5)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:48:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f3b2e71-da69-4913-84de-c7715e867d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:48:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f3b2e71-da69-4913-84de-c7715e867d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:48:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fafda21-4db6-4824-b097-49467d8b6d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:48:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fafda21-4db6-4824-b097-49467d8b6d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6', 'volume_name': 'volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:48:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a63b7ae-931d-41b4-9ec7-517bb06ca755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:48:20 devstack sudo[83737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.8787e810-9e54-4a07-8a14-7e0626684b87 1G Apr 25 15:48:20 devstack sudo[83737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a63b7ae-931d-41b4-9ec7-517bb06ca755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:48:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c45ee71e-8927-4801-9ccc-ac55cc6c6bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:48:20 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] Volume e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6', 'volume_size': 1} Apr 25 15:48:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:48:21 devstack sudo[83737]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e5c3b1fb-4605-43ff-8f99-6f1c6df86904 tempest-SnapshotsActionsTest-549497535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.8787e810-9e54-4a07-8a14-7e0626684b87 1G" returned: 0 in 0.709s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e5c3b1fb-4605-43ff-8f99-6f1c6df86904 tempest-SnapshotsActionsTest-549497535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.8787e810-9e54-4a07-8a14-7e0626684b87 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:21 devstack sudo[83745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.8787e810-9e54-4a07-8a14-7e0626684b87 Apr 25 15:48:21 devstack sudo[83745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:21 devstack sudo[83745]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e5c3b1fb-4605-43ff-8f99-6f1c6df86904 tempest-SnapshotsActionsTest-549497535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.8787e810-9e54-4a07-8a14-7e0626684b87" returned: 0 in 0.544s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:21 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-e5c3b1fb-4605-43ff-8f99-6f1c6df86904 tempest-SnapshotsActionsTest-549497535 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.8787e810-9e54-4a07-8a14-7e0626684b87 is being set with open permissions: ugo+rw Apr 25 15:48:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e5c3b1fb-4605-43ff-8f99-6f1c6df86904 tempest-SnapshotsActionsTest-549497535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.8787e810-9e54-4a07-8a14-7e0626684b87 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:21 devstack sudo[83750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.8787e810-9e54-4a07-8a14-7e0626684b87 Apr 25 15:48:21 devstack sudo[83750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:22 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:UPDATE=91,cinder:SELECT=68,cinder:INSERT=21,cinder:DELETE=8 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:48:22 devstack sudo[83750]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e5c3b1fb-4605-43ff-8f99-6f1c6df86904 tempest-SnapshotsActionsTest-549497535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.8787e810-9e54-4a07-8a14-7e0626684b87" returned: 0 in 0.542s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e5c3b1fb-4605-43ff-8f99-6f1c6df86904 tempest-SnapshotsActionsTest-549497535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.632s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:48:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.769s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:48:22 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=80cc7f32-d97a-4e7d-89cf-6f2fa8b1fb7d,created_at=2026-04-25T13:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-236258127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=80cc7f32-d97a-4e7d-89cf-6f2fa8b1fb7d,host='devstack@QuobyteHD#QuobyteHD',id=e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fce156ffabb4b57aef047b587bf194d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:48:21Z,use_quota=True,user_id='aaefbbda6ecb422bb0daaaad82e2752a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2ac6f5ca-6374-4179-866b-6b764d11a0a5),volume_type_id=2ac6f5ca-6374-4179-866b-6b764d11a0a5)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:48:22 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] Creating volume e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:48:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:48:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:48:22 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:48:22 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:48:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:48:22 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:48:22 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:48:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:22 devstack sudo[83753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6 1073741824 Apr 25 15:48:22 devstack sudo[83753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:22 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-e5c3b1fb-4605-43ff-8f99-6f1c6df86904 tempest-SnapshotsActionsTest-549497535 None] Create snapshot completed successfully Apr 25 15:48:23 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a54b8eb5-19fb-4b1f-9d19-36a3f4356c83 tempest-SnapshotsActionsTest-997544256 None] Acquiring lock "cinder-8787e810-9e54-4a07-8a14-7e0626684b87-delete_snapshot" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:48:23 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a54b8eb5-19fb-4b1f-9d19-36a3f4356c83 tempest-SnapshotsActionsTest-997544256 None] Lock "cinder-8787e810-9e54-4a07-8a14-7e0626684b87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:48:23 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a54b8eb5-19fb-4b1f-9d19-36a3f4356c83 tempest-SnapshotsActionsTest-997544256 None] Acquiring lock "cinder-quobyte-8c133976-dc67-47d4-b1e8-dc68fb41f2ca" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:48:23 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a54b8eb5-19fb-4b1f-9d19-36a3f4356c83 tempest-SnapshotsActionsTest-997544256 None] Lock "cinder-quobyte-8c133976-dc67-47d4-b1e8-dc68fb41f2ca" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:48:23 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a54b8eb5-19fb-4b1f-9d19-36a3f4356c83 tempest-SnapshotsActionsTest-997544256 None] Acquiring lock "cinder-quobyte-8787e810-9e54-4a07-8a14-7e0626684b87" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:48:23 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a54b8eb5-19fb-4b1f-9d19-36a3f4356c83 tempest-SnapshotsActionsTest-997544256 None] Lock "cinder-quobyte-8787e810-9e54-4a07-8a14-7e0626684b87" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:48:23 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-a54b8eb5-19fb-4b1f-9d19-36a3f4356c83 tempest-SnapshotsActionsTest-997544256 None] Deleting offline snapshot 8787e810-9e54-4a07-8a14-7e0626684b87 of volume 8c133976-dc67-47d4-b1e8-dc68fb41f2ca {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 15:48:23 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-a54b8eb5-19fb-4b1f-9d19-36a3f4356c83 tempest-SnapshotsActionsTest-997544256 None] snapshot_file for this snap is: volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.8787e810-9e54-4a07-8a14-7e0626684b87 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 15:48:23 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[d645bb3a-aff2-4661-a175-ffe051fd6633]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:48:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a54b8eb5-19fb-4b1f-9d19-36a3f4356c83 tempest-SnapshotsActionsTest-997544256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.8787e810-9e54-4a07-8a14-7e0626684b87 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:23 devstack sudo[83753]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6 1073741824" returned: 0 in 0.747s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:23 devstack sudo[83762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.8787e810-9e54-4a07-8a14-7e0626684b87 Apr 25 15:48:23 devstack sudo[83762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:23 devstack sudo[83764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6 Apr 25 15:48:23 devstack sudo[83764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:23 devstack sudo[83762]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a54b8eb5-19fb-4b1f-9d19-36a3f4356c83 tempest-SnapshotsActionsTest-997544256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.8787e810-9e54-4a07-8a14-7e0626684b87" returned: 0 in 0.569s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:23 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-a54b8eb5-19fb-4b1f-9d19-36a3f4356c83 tempest-SnapshotsActionsTest-997544256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:48:23 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d9fddf-d388-4144-b82d-493c00dac971]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:48:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a54b8eb5-19fb-4b1f-9d19-36a3f4356c83 tempest-SnapshotsActionsTest-997544256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:23 devstack sudo[83764]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6" returned: 0 in 0.547s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:23 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:48:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:48:23 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c45ee71e-8927-4801-9ccc-ac55cc6c6bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:48:23 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (076360b0-e5cc-4fcd-a6d4-b9a077702d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:48:23 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] Volume volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6 (e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6): created successfully Apr 25 15:48:23 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (076360b0-e5cc-4fcd-a6d4-b9a077702d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:48:23 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] Flow 'volume_create_manager' (d59ff157-2ade-41a0-99f7-5586ba4a3291) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:48:23 devstack sudo[83772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 Apr 25 15:48:23 devstack sudo[83772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:23 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-b9741e0a-68bb-4931-b208-38ceeed9e389 tempest-GroupSnapshotsTest-536830151 None] Created volume successfully. Apr 25 15:48:24 devstack sudo[83772]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a54b8eb5-19fb-4b1f-9d19-36a3f4356c83 tempest-SnapshotsActionsTest-997544256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869" returned: 0 in 0.596s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:24 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-a54b8eb5-19fb-4b1f-9d19-36a3f4356c83 tempest-SnapshotsActionsTest-997544256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:48:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a54b8eb5-19fb-4b1f-9d19-36a3f4356c83 tempest-SnapshotsActionsTest-997544256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.8787e810-9e54-4a07-8a14-7e0626684b87 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:24 devstack sudo[83777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.8787e810-9e54-4a07-8a14-7e0626684b87 Apr 25 15:48:24 devstack sudo[83777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:24 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-63e86b7b-adf8-4e59-8430-0ab8986e07c6 tempest-GroupSnapshotsTest-536830151 None] GroupSnapshot 4e8da4b6-7125-4d03-a142-215a9499b048: creating. Apr 25 15:48:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-63e86b7b-adf8-4e59-8430-0ab8986e07c6 tempest-GroupSnapshotsTest-536830151 None] Group snapshot 4e8da4b6-7125-4d03-a142-215a9499b048: creating. {{(pid=81828) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 25 15:48:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-63e86b7b-adf8-4e59-8430-0ab8986e07c6 tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:48:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-63e86b7b-adf8-4e59-8430-0ab8986e07c6 tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:48:24 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-63e86b7b-adf8-4e59-8430-0ab8986e07c6 tempest-GroupSnapshotsTest-536830151 None] Creating offline snapshot d38831cb-6df2-4cda-8118-a7bd7d309963 of volume e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6 {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 15:48:24 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9431af-1915-4a99-958f-11b46081e30d]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:48:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-63e86b7b-adf8-4e59-8430-0ab8986e07c6 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:24 devstack sudo[83780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6 Apr 25 15:48:24 devstack sudo[83780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:25 devstack sudo[83777]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a54b8eb5-19fb-4b1f-9d19-36a3f4356c83 tempest-SnapshotsActionsTest-997544256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.8787e810-9e54-4a07-8a14-7e0626684b87" returned: 0 in 0.817s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a54b8eb5-19fb-4b1f-9d19-36a3f4356c83 tempest-SnapshotsActionsTest-997544256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.8787e810-9e54-4a07-8a14-7e0626684b87 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:25 devstack sudo[83788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.8787e810-9e54-4a07-8a14-7e0626684b87 Apr 25 15:48:25 devstack sudo[83788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:25 devstack sudo[83780]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-63e86b7b-adf8-4e59-8430-0ab8986e07c6 tempest-GroupSnapshotsTest-536830151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6" returned: 0 in 0.754s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-63e86b7b-adf8-4e59-8430-0ab8986e07c6 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6.d38831cb-6df2-4cda-8118-a7bd7d309963 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:25 devstack sudo[83790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6.d38831cb-6df2-4cda-8118-a7bd7d309963 1G Apr 25 15:48:25 devstack sudo[83790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:25 devstack sudo[83788]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a54b8eb5-19fb-4b1f-9d19-36a3f4356c83 tempest-SnapshotsActionsTest-997544256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.8787e810-9e54-4a07-8a14-7e0626684b87" returned: 0 in 0.674s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:25 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a54b8eb5-19fb-4b1f-9d19-36a3f4356c83 tempest-SnapshotsActionsTest-997544256 None] Lock "cinder-quobyte-8787e810-9e54-4a07-8a14-7e0626684b87" released by "_delete_snapshot" :: held 2.743s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:48:25 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a54b8eb5-19fb-4b1f-9d19-36a3f4356c83 tempest-SnapshotsActionsTest-997544256 None] Lock "cinder-quobyte-8c133976-dc67-47d4-b1e8-dc68fb41f2ca" released by "delete_snapshot" :: held 2.772s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:48:26 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-a54b8eb5-19fb-4b1f-9d19-36a3f4356c83 tempest-SnapshotsActionsTest-997544256 None] Created reservations ['9fc84665-51d6-4ee6-b249-f33fc57cc938', '1ac8c545-47d5-488f-afe4-99d0a68ee685', '10904a8f-c9ae-4b9f-b113-a8d5c540a4e2', '8699adc5-9423-4871-8380-6ea188109909'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:48:26 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-a54b8eb5-19fb-4b1f-9d19-36a3f4356c83 tempest-SnapshotsActionsTest-997544256 None] Delete snapshot completed successfully. Apr 25 15:48:26 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a54b8eb5-19fb-4b1f-9d19-36a3f4356c83 tempest-SnapshotsActionsTest-997544256 None] Lock "cinder-8787e810-9e54-4a07-8a14-7e0626684b87-delete_snapshot" released by "delete_snapshot" :: held 2.955s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:48:26 devstack sudo[83790]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-63e86b7b-adf8-4e59-8430-0ab8986e07c6 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6.d38831cb-6df2-4cda-8118-a7bd7d309963 1G" returned: 0 in 0.801s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-63e86b7b-adf8-4e59-8430-0ab8986e07c6 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6.d38831cb-6df2-4cda-8118-a7bd7d309963 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:26 devstack sudo[83796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6.d38831cb-6df2-4cda-8118-a7bd7d309963 Apr 25 15:48:26 devstack sudo[83796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-63fe2af9-c47f-4287-9a08-e21cc27a9eae tempest-SnapshotsActionsTest-549497535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:48:26 devstack sudo[83796]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-63e86b7b-adf8-4e59-8430-0ab8986e07c6 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6.d38831cb-6df2-4cda-8118-a7bd7d309963" returned: 0 in 0.643s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:26 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-63e86b7b-adf8-4e59-8430-0ab8986e07c6 tempest-GroupSnapshotsTest-536830151 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6.d38831cb-6df2-4cda-8118-a7bd7d309963 is being set with open permissions: ugo+rw: NotImplementedError Apr 25 15:48:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-63e86b7b-adf8-4e59-8430-0ab8986e07c6 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6.d38831cb-6df2-4cda-8118-a7bd7d309963 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:26 devstack sudo[83807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6.d38831cb-6df2-4cda-8118-a7bd7d309963 Apr 25 15:48:26 devstack sudo[83807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:27 devstack sudo[83807]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-63e86b7b-adf8-4e59-8430-0ab8986e07c6 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6.d38831cb-6df2-4cda-8118-a7bd7d309963" returned: 0 in 0.484s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-63e86b7b-adf8-4e59-8430-0ab8986e07c6 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:27 devstack sudo[83822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6.info Apr 25 15:48:27 devstack sudo[83822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:27 devstack sudo[83822]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-63e86b7b-adf8-4e59-8430-0ab8986e07c6 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6.info" returned: 0 in 0.519s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:27 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-63e86b7b-adf8-4e59-8430-0ab8986e07c6 tempest-GroupSnapshotsTest-536830151 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6.info is being set with open permissions: ugo+rw: NotImplementedError Apr 25 15:48:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-63e86b7b-adf8-4e59-8430-0ab8986e07c6 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:27 devstack sudo[83826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6.info Apr 25 15:48:27 devstack sudo[83826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:28 devstack sudo[83826]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-63e86b7b-adf8-4e59-8430-0ab8986e07c6 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6.info" returned: 0 in 0.590s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-63e86b7b-adf8-4e59-8430-0ab8986e07c6 tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.892s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:48:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-63fe2af9-c47f-4287-9a08-e21cc27a9eae tempest-SnapshotsActionsTest-549497535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.787s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:48:28 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-63fe2af9-c47f-4287-9a08-e21cc27a9eae tempest-SnapshotsActionsTest-549497535 None] Creating offline snapshot 4e4f0882-bc62-413a-b595-9fdbdabcace2 of volume 8c133976-dc67-47d4-b1e8-dc68fb41f2ca {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 15:48:28 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86bc70c-1c33-4207-aed7-d900d5e4f538]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:48:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-63fe2af9-c47f-4287-9a08-e21cc27a9eae tempest-SnapshotsActionsTest-549497535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:28 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-63e86b7b-adf8-4e59-8430-0ab8986e07c6 tempest-GroupSnapshotsTest-536830151 None] group_snapshot 4e8da4b6-7125-4d03-a142-215a9499b048: created successfully Apr 25 15:48:28 devstack sudo[83835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 Apr 25 15:48:28 devstack sudo[83835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:29 devstack sudo[83835]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-63fe2af9-c47f-4287-9a08-e21cc27a9eae tempest-SnapshotsActionsTest-549497535 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869" returned: 0 in 0.746s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:29 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-63fe2af9-c47f-4287-9a08-e21cc27a9eae tempest-SnapshotsActionsTest-549497535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:48:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-63fe2af9-c47f-4287-9a08-e21cc27a9eae tempest-SnapshotsActionsTest-549497535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.4e4f0882-bc62-413a-b595-9fdbdabcace2 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:29 devstack sudo[83841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.4e4f0882-bc62-413a-b595-9fdbdabcace2 1G Apr 25 15:48:29 devstack sudo[83841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:29 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:48:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Flow 'volume_create_manager' (0be71b92-028e-4a1c-9a92-55d4bcfde08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:48:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51633d4e-9d47-42b6-a1d0-0bef5caab797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:48:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51633d4e-9d47-42b6-a1d0-0bef5caab797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:48:29Z,deleted=False,deleted_at=None,display_description='',display_name='d7a73a0c-f54a-4f1b-8013-3f6ed278ba05-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cee2317-3b94-469a-91ad-b66c355cb3b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eeb6c17f5ca4343b865fc5813dd09d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:48:29Z,use_quota=True,user_id='ca260fa0e18c49ec86bb079c4a7c0f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:48:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf34215a-e231-4378-8312-763cb4c5e8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:48:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf34215a-e231-4378-8312-763cb4c5e8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:48:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e930f2-e88a-43e5-a843-6c4da1a3c144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:48:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e930f2-e88a-43e5-a843-6c4da1a3c144) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cee2317-3b94-469a-91ad-b66c355cb3b8', 'volume_name': 'volume-3cee2317-3b94-469a-91ad-b66c355cb3b8', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:48:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80669a0a-2b02-4591-bccb-7379fbce5c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:48:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80669a0a-2b02-4591-bccb-7379fbce5c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:48:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (756fe2ee-b913-46b8-b14b-672364ea7c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:48:29 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Volume 3cee2317-3b94-469a-91ad-b66c355cb3b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cee2317-3b94-469a-91ad-b66c355cb3b8', 'volume_size': 1} Apr 25 15:48:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:48:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:48:30 devstack sudo[83841]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-63fe2af9-c47f-4287-9a08-e21cc27a9eae tempest-SnapshotsActionsTest-549497535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.4e4f0882-bc62-413a-b595-9fdbdabcace2 1G" returned: 0 in 0.870s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-63fe2af9-c47f-4287-9a08-e21cc27a9eae tempest-SnapshotsActionsTest-549497535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.4e4f0882-bc62-413a-b595-9fdbdabcace2 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:30 devstack sudo[83851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.4e4f0882-bc62-413a-b595-9fdbdabcace2 Apr 25 15:48:30 devstack sudo[83851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:30 devstack sudo[83851]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-63fe2af9-c47f-4287-9a08-e21cc27a9eae tempest-SnapshotsActionsTest-549497535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.4e4f0882-bc62-413a-b595-9fdbdabcace2" returned: 0 in 0.508s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:30 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-63fe2af9-c47f-4287-9a08-e21cc27a9eae tempest-SnapshotsActionsTest-549497535 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.4e4f0882-bc62-413a-b595-9fdbdabcace2 is being set with open permissions: ugo+rw Apr 25 15:48:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-63fe2af9-c47f-4287-9a08-e21cc27a9eae tempest-SnapshotsActionsTest-549497535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.4e4f0882-bc62-413a-b595-9fdbdabcace2 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:30 devstack sudo[83856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.4e4f0882-bc62-413a-b595-9fdbdabcace2 Apr 25 15:48:30 devstack sudo[83856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:31 devstack sudo[83856]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-63fe2af9-c47f-4287-9a08-e21cc27a9eae tempest-SnapshotsActionsTest-549497535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.4e4f0882-bc62-413a-b595-9fdbdabcace2" returned: 0 in 0.471s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-63fe2af9-c47f-4287-9a08-e21cc27a9eae tempest-SnapshotsActionsTest-549497535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.725s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:48:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.616s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:48:31 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:48:29Z,deleted=False,deleted_at=None,display_description='',display_name='d7a73a0c-f54a-4f1b-8013-3f6ed278ba05-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cee2317-3b94-469a-91ad-b66c355cb3b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eeb6c17f5ca4343b865fc5813dd09d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:48:29Z,use_quota=True,user_id='ca260fa0e18c49ec86bb079c4a7c0f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:48:31 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Creating volume 3cee2317-3b94-469a-91ad-b66c355cb3b8 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:48:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:48:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:48:31 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:48:31 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:48:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:48:31 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:48:31 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:48:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3cee2317-3b94-469a-91ad-b66c355cb3b8 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:31 devstack sudo[83860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3cee2317-3b94-469a-91ad-b66c355cb3b8 1073741824 Apr 25 15:48:31 devstack sudo[83860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:31 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-63fe2af9-c47f-4287-9a08-e21cc27a9eae tempest-SnapshotsActionsTest-549497535 None] Create snapshot completed successfully Apr 25 15:48:31 devstack sudo[83860]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3cee2317-3b94-469a-91ad-b66c355cb3b8 1073741824" returned: 0 in 0.720s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3cee2317-3b94-469a-91ad-b66c355cb3b8 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:31 devstack sudo[83868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3cee2317-3b94-469a-91ad-b66c355cb3b8 Apr 25 15:48:31 devstack sudo[83868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-71225507-880d-4684-b002-8983a028c378 tempest-SnapshotsActionsTest-997544256 None] Acquiring lock "cinder-4e4f0882-bc62-413a-b595-9fdbdabcace2-delete_snapshot" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-71225507-880d-4684-b002-8983a028c378 tempest-SnapshotsActionsTest-997544256 None] Lock "cinder-4e4f0882-bc62-413a-b595-9fdbdabcace2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-71225507-880d-4684-b002-8983a028c378 tempest-SnapshotsActionsTest-997544256 None] Acquiring lock "cinder-quobyte-8c133976-dc67-47d4-b1e8-dc68fb41f2ca" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-71225507-880d-4684-b002-8983a028c378 tempest-SnapshotsActionsTest-997544256 None] Lock "cinder-quobyte-8c133976-dc67-47d4-b1e8-dc68fb41f2ca" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-71225507-880d-4684-b002-8983a028c378 tempest-SnapshotsActionsTest-997544256 None] Acquiring lock "cinder-quobyte-4e4f0882-bc62-413a-b595-9fdbdabcace2" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-71225507-880d-4684-b002-8983a028c378 tempest-SnapshotsActionsTest-997544256 None] Lock "cinder-quobyte-4e4f0882-bc62-413a-b595-9fdbdabcace2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-71225507-880d-4684-b002-8983a028c378 tempest-SnapshotsActionsTest-997544256 None] Deleting offline snapshot 4e4f0882-bc62-413a-b595-9fdbdabcace2 of volume 8c133976-dc67-47d4-b1e8-dc68fb41f2ca {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-71225507-880d-4684-b002-8983a028c378 tempest-SnapshotsActionsTest-997544256 None] snapshot_file for this snap is: volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.4e4f0882-bc62-413a-b595-9fdbdabcace2 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2028a0-8978-427c-8bba-c4b52c59c9d9]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-71225507-880d-4684-b002-8983a028c378 tempest-SnapshotsActionsTest-997544256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.4e4f0882-bc62-413a-b595-9fdbdabcace2 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:32 devstack sudo[83873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.4e4f0882-bc62-413a-b595-9fdbdabcace2 Apr 25 15:48:32 devstack sudo[83873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:32 devstack sudo[83868]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3cee2317-3b94-469a-91ad-b66c355cb3b8" returned: 0 in 0.469s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.392s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "cinder-quobyte-d38831cb-6df2-4cda-8118-a7bd7d309963-88091394-ec1e-421a-bc7f-36f941de3190" by "_create_volume_from_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (756fe2ee-b913-46b8-b14b-672364ea7c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cee2317-3b94-469a-91ad-b66c355cb3b8', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df046d73-bb2a-427b-9e88-25a59c6f2161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] Lock "cinder-quobyte-d38831cb-6df2-4cda-8118-a7bd7d309963-88091394-ec1e-421a-bc7f-36f941de3190" acquired by "_create_volume_from_snapshot" :: waited 0.066s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] Creating volume 88091394-ec1e-421a-bc7f-36f941de3190 from snapshot d38831cb-6df2-4cda-8118-a7bd7d309963 {{(pid=81828) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "cinder-quobyte-88091394-ec1e-421a-bc7f-36f941de3190" by "_copy_volume_from_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:48:32 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Volume volume-3cee2317-3b94-469a-91ad-b66c355cb3b8 (3cee2317-3b94-469a-91ad-b66c355cb3b8): created successfully Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df046d73-bb2a-427b-9e88-25a59c6f2161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Flow 'volume_create_manager' (0be71b92-028e-4a1c-9a92-55d4bcfde08e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] Lock "cinder-quobyte-88091394-ec1e-421a-bc7f-36f941de3190" acquired by "_copy_volume_from_snapshot" :: waited 0.054s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] snapshot: d38831cb-6df2-4cda-8118-a7bd7d309963, volume: 88091394-ec1e-421a-bc7f-36f941de3190, {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 25 15:48:32 devstack cinder-volume[81828]: INFO cinder.volume.manager [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-db23017d-5a01-403f-abe4-880818cf368a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Created volume successfully. Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f61834-1ebc-419f-8564-4b50b983a162]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6.d38831cb-6df2-4cda-8118-a7bd7d309963 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:32 devstack sudo[83873]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-71225507-880d-4684-b002-8983a028c378 tempest-SnapshotsActionsTest-997544256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.4e4f0882-bc62-413a-b595-9fdbdabcace2" returned: 0 in 0.605s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-71225507-880d-4684-b002-8983a028c378 tempest-SnapshotsActionsTest-997544256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa69986-b76e-4893-8979-d7e1c706b865]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:48:32 devstack sudo[83883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6.d38831cb-6df2-4cda-8118-a7bd7d309963 Apr 25 15:48:32 devstack sudo[83883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-71225507-880d-4684-b002-8983a028c378 tempest-SnapshotsActionsTest-997544256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:32 devstack sudo[83887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 Apr 25 15:48:32 devstack sudo[83887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:33 devstack sudo[83883]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6.d38831cb-6df2-4cda-8118-a7bd7d309963" returned: 0 in 0.663s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:33 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:48:33 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] will copy from snapshot at /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6 {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 25 15:48:33 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] Creating direct copy from snapshot {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 25 15:48:33 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad2cc76-5cba-45e0-97e4-9e1542dc8bd0]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:48:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:33 devstack sudo[83887]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:33 devstack sudo[83912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6 Apr 25 15:48:33 devstack sudo[83912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-71225507-880d-4684-b002-8983a028c378 tempest-SnapshotsActionsTest-997544256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869" returned: 0 in 0.710s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:33 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-71225507-880d-4684-b002-8983a028c378 tempest-SnapshotsActionsTest-997544256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:48:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-71225507-880d-4684-b002-8983a028c378 tempest-SnapshotsActionsTest-997544256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.4e4f0882-bc62-413a-b595-9fdbdabcace2 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:33 devstack sudo[83915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.4e4f0882-bc62-413a-b595-9fdbdabcace2 Apr 25 15:48:33 devstack sudo[83915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:34 devstack sudo[83912]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6" returned: 0 in 0.818s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:34 devstack cinder-volume[81828]: DEBUG cinder.utils [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] Path /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-88091394-ec1e-421a-bc7f-36f941de3190 not found in is_blk_device check {{(pid=81828) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 25 15:48:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-88091394-ec1e-421a-bc7f-36f941de3190 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:34 devstack sudo[83938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-88091394-ec1e-421a-bc7f-36f941de3190 Apr 25 15:48:34 devstack sudo[83938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:34 devstack sudo[83915]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-71225507-880d-4684-b002-8983a028c378 tempest-SnapshotsActionsTest-997544256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.4e4f0882-bc62-413a-b595-9fdbdabcace2" returned: 0 in 0.805s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-71225507-880d-4684-b002-8983a028c378 tempest-SnapshotsActionsTest-997544256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.4e4f0882-bc62-413a-b595-9fdbdabcace2 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:34 devstack sudo[83941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.4e4f0882-bc62-413a-b595-9fdbdabcace2 Apr 25 15:48:34 devstack sudo[83941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:34 devstack sudo[83941]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-71225507-880d-4684-b002-8983a028c378 tempest-SnapshotsActionsTest-997544256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.4e4f0882-bc62-413a-b595-9fdbdabcace2" returned: 0 in 0.603s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:34 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-71225507-880d-4684-b002-8983a028c378 tempest-SnapshotsActionsTest-997544256 None] Lock "cinder-quobyte-4e4f0882-bc62-413a-b595-9fdbdabcace2" released by "_delete_snapshot" :: held 2.850s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:48:34 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-71225507-880d-4684-b002-8983a028c378 tempest-SnapshotsActionsTest-997544256 None] Lock "cinder-quobyte-8c133976-dc67-47d4-b1e8-dc68fb41f2ca" released by "delete_snapshot" :: held 2.875s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:48:35 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-71225507-880d-4684-b002-8983a028c378 tempest-SnapshotsActionsTest-997544256 None] Created reservations ['80833784-0074-4b3d-97bc-7ca03648aa87', 'dc5a8d51-5082-44cd-8343-6d169d7a4f07', '2b419bbe-729a-422d-a5ed-aa9e4de142ce', 'adda0a01-8810-49cf-b9e2-6df4a13df713'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:48:35 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-71225507-880d-4684-b002-8983a028c378 tempest-SnapshotsActionsTest-997544256 None] Delete snapshot completed successfully. Apr 25 15:48:35 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-71225507-880d-4684-b002-8983a028c378 tempest-SnapshotsActionsTest-997544256 None] Lock "cinder-4e4f0882-bc62-413a-b595-9fdbdabcace2-delete_snapshot" released by "delete_snapshot" :: held 3.329s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:48:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-9a69c538-a1b5-46f1-bcc8-a382e9ba46eb tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:48:37 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-66049183-075a-4c3e-a6fc-daab57cd72b6 tempest-SnapshotsActionsTest-549497535 None] Acquiring lock "cinder-acdc3b37-4504-410b-8ae7-f40c04851869-delete_snapshot" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:48:38 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-66049183-075a-4c3e-a6fc-daab57cd72b6 tempest-SnapshotsActionsTest-549497535 None] Lock "cinder-acdc3b37-4504-410b-8ae7-f40c04851869-delete_snapshot" acquired by "delete_snapshot" :: waited 0.085s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:48:38 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-66049183-075a-4c3e-a6fc-daab57cd72b6 tempest-SnapshotsActionsTest-549497535 None] Acquiring lock "cinder-quobyte-8c133976-dc67-47d4-b1e8-dc68fb41f2ca" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:48:38 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-66049183-075a-4c3e-a6fc-daab57cd72b6 tempest-SnapshotsActionsTest-549497535 None] Lock "cinder-quobyte-8c133976-dc67-47d4-b1e8-dc68fb41f2ca" acquired by "delete_snapshot" :: waited 0.034s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:48:38 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-66049183-075a-4c3e-a6fc-daab57cd72b6 tempest-SnapshotsActionsTest-549497535 None] Acquiring lock "cinder-quobyte-acdc3b37-4504-410b-8ae7-f40c04851869" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:48:38 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-66049183-075a-4c3e-a6fc-daab57cd72b6 tempest-SnapshotsActionsTest-549497535 None] Lock "cinder-quobyte-acdc3b37-4504-410b-8ae7-f40c04851869" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:48:38 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-66049183-075a-4c3e-a6fc-daab57cd72b6 tempest-SnapshotsActionsTest-549497535 None] Deleting offline snapshot acdc3b37-4504-410b-8ae7-f40c04851869 of volume 8c133976-dc67-47d4-b1e8-dc68fb41f2ca {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 15:48:38 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-66049183-075a-4c3e-a6fc-daab57cd72b6 tempest-SnapshotsActionsTest-549497535 None] snapshot_file for this snap is: volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 15:48:38 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[14696d20-45cf-4739-b27f-ab72016d4aaf]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:48:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-66049183-075a-4c3e-a6fc-daab57cd72b6 tempest-SnapshotsActionsTest-549497535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:38 devstack sudo[83978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 Apr 25 15:48:38 devstack sudo[83978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:39 devstack sudo[83978]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-66049183-075a-4c3e-a6fc-daab57cd72b6 tempest-SnapshotsActionsTest-549497535 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869" returned: 0 in 1.460s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:39 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-66049183-075a-4c3e-a6fc-daab57cd72b6 tempest-SnapshotsActionsTest-549497535 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:48:39 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[adee903b-c6a2-492a-a722-81087dd3f200]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:48:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-66049183-075a-4c3e-a6fc-daab57cd72b6 tempest-SnapshotsActionsTest-549497535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:39 devstack sudo[83988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca Apr 25 15:48:39 devstack sudo[83988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:41 devstack sudo[83988]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-66049183-075a-4c3e-a6fc-daab57cd72b6 tempest-SnapshotsActionsTest-549497535 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca" returned: 0 in 1.806s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-66049183-075a-4c3e-a6fc-daab57cd72b6 tempest-SnapshotsActionsTest-549497535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:41 devstack sudo[83996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 Apr 25 15:48:41 devstack sudo[83996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:42 devstack sudo[83938]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-88091394-ec1e-421a-bc7f-36f941de3190" returned: 0 in 8.283s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:42 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[249b5909-3cd4-4717-bba7-7f1be65190f3]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:48:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:42 devstack sudo[83998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6 Apr 25 15:48:42 devstack sudo[83998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:42 devstack sudo[83996]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-66049183-075a-4c3e-a6fc-daab57cd72b6 tempest-SnapshotsActionsTest-549497535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869" returned: 0 in 1.197s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-66049183-075a-4c3e-a6fc-daab57cd72b6 tempest-SnapshotsActionsTest-549497535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:42 devstack sudo[84003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869 Apr 25 15:48:42 devstack sudo[84003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:43 devstack sudo[83998]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6" returned: 0 in 0.761s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:43 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] Image conversion details: src /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6, size 1024.00 MB, duration 8.28 sec, destination /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-88091394-ec1e-421a-bc7f-36f941de3190 {{(pid=81828) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 15:48:43 devstack cinder-volume[81828]: INFO cinder.image.image_utils [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] Converted 1024.00 MB image at 123.61 MB/s Apr 25 15:48:43 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-88091394-ec1e-421a-bc7f-36f941de3190 is being set with open permissions: ugo+rw: NotImplementedError Apr 25 15:48:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-88091394-ec1e-421a-bc7f-36f941de3190 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:43 devstack sudo[84011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-88091394-ec1e-421a-bc7f-36f941de3190 Apr 25 15:48:43 devstack sudo[84011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:43 devstack sudo[84003]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-66049183-075a-4c3e-a6fc-daab57cd72b6 tempest-SnapshotsActionsTest-549497535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca.acdc3b37-4504-410b-8ae7-f40c04851869" returned: 0 in 0.495s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-66049183-075a-4c3e-a6fc-daab57cd72b6 tempest-SnapshotsActionsTest-549497535 None] Lock "cinder-quobyte-acdc3b37-4504-410b-8ae7-f40c04851869" released by "_delete_snapshot" :: held 5.215s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:48:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-66049183-075a-4c3e-a6fc-daab57cd72b6 tempest-SnapshotsActionsTest-549497535 None] Lock "cinder-quobyte-8c133976-dc67-47d4-b1e8-dc68fb41f2ca" released by "delete_snapshot" :: held 5.252s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:48:43 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-66049183-075a-4c3e-a6fc-daab57cd72b6 tempest-SnapshotsActionsTest-549497535 None] Created reservations ['fbc1d36c-0b9b-44aa-ab1e-ec11a2da8b50', '41197f9d-07f5-4b37-8fde-5ad3c2eeacf7', '14274d9f-fb3f-4ed3-8841-6442567afe32', '0bb8e6e9-33bb-46b4-829c-3a7ca032fddb'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:48:43 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-66049183-075a-4c3e-a6fc-daab57cd72b6 tempest-SnapshotsActionsTest-549497535 None] Delete snapshot completed successfully. Apr 25 15:48:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-66049183-075a-4c3e-a6fc-daab57cd72b6 tempest-SnapshotsActionsTest-549497535 None] Lock "cinder-acdc3b37-4504-410b-8ae7-f40c04851869-delete_snapshot" released by "delete_snapshot" :: held 5.500s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:48:43 devstack sudo[84011]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-88091394-ec1e-421a-bc7f-36f941de3190" returned: 0 in 0.701s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] Lock "cinder-quobyte-88091394-ec1e-421a-bc7f-36f941de3190" released by "_copy_volume_from_snapshot" :: held 11.356s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:48:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] Lock "cinder-quobyte-d38831cb-6df2-4cda-8118-a7bd7d309963-88091394-ec1e-421a-bc7f-36f941de3190" released by "_create_volume_from_snapshot" :: held 11.442s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:48:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.512s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:48:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-9a69c538-a1b5-46f1-bcc8-a382e9ba46eb tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.831s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:48:43 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f67614-422a-4d4e-810a-d0bd44b4937b]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:48:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-9a69c538-a1b5-46f1-bcc8-a382e9ba46eb tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3cee2317-3b94-469a-91ad-b66c355cb3b8 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:44 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-3cf2e3ef-5ab3-44e8-9d37-9c200424674d tempest-GroupSnapshotsTest-536830151 None] Create group from source-snapshot-4e8da4b6-7125-4d03-a142-215a9499b048 completed successfully. Apr 25 15:48:44 devstack sudo[84014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3cee2317-3b94-469a-91ad-b66c355cb3b8 Apr 25 15:48:44 devstack sudo[84014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:44 devstack sudo[84014]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-9a69c538-a1b5-46f1-bcc8-a382e9ba46eb tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3cee2317-3b94-469a-91ad-b66c355cb3b8" returned: 0 in 0.603s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-9a69c538-a1b5-46f1-bcc8-a382e9ba46eb tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.633s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:48:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-9a69c538-a1b5-46f1-bcc8-a382e9ba46eb tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf', 'name': 'volume-3cee2317-3b94-469a-91ad-b66c355cb3b8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '67fecaa3-6244-4c01-9de9-72fe208a3065', 'enforce_multipath': True} {{(pid=81828) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 25 15:48:44 devstack cinder-volume[81828]: INFO cinder.volume.manager [req-b908691a-8651-4e48-91f5-fd40de7aa74d req-9a69c538-a1b5-46f1-bcc8-a382e9ba46eb tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] attachment_update completed successfully. Apr 25 15:48:44 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-99b171ca-913a-4863-b972-700ec3e855b1 tempest-SnapshotsActionsTest-549497535 None] Acquiring lock "cinder-8c133976-dc67-47d4-b1e8-dc68fb41f2ca-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:48:44 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-99b171ca-913a-4863-b972-700ec3e855b1 tempest-SnapshotsActionsTest-549497535 None] Lock "cinder-8c133976-dc67-47d4-b1e8-dc68fb41f2ca-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:48:44 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-99b171ca-913a-4863-b972-700ec3e855b1 tempest-SnapshotsActionsTest-549497535 None] Acquiring lock "cinder-quobyte-8c133976-dc67-47d4-b1e8-dc68fb41f2ca" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:48:45 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-99b171ca-913a-4863-b972-700ec3e855b1 tempest-SnapshotsActionsTest-549497535 None] Lock "cinder-quobyte-8c133976-dc67-47d4-b1e8-dc68fb41f2ca" acquired by "delete_volume" :: waited 0.069s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:48:45 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[87eac0cb-4392-4f60-9341-5cf9bc700b7e]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:48:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-99b171ca-913a-4863-b972-700ec3e855b1 tempest-SnapshotsActionsTest-549497535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:45 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7262a648-200d-40e7-8114-f755e2524bcc tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "cinder-quobyte-88091394-ec1e-421a-bc7f-36f941de3190" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:48:45 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7262a648-200d-40e7-8114-f755e2524bcc tempest-GroupSnapshotsTest-536830151 None] Lock "cinder-quobyte-88091394-ec1e-421a-bc7f-36f941de3190" acquired by "delete_volume" :: waited 0.027s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:48:45 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ea63a2-18fb-419d-afbe-10853ec6431b]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:48:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7262a648-200d-40e7-8114-f755e2524bcc tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-88091394-ec1e-421a-bc7f-36f941de3190 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:45 devstack sudo[84021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-88091394-ec1e-421a-bc7f-36f941de3190 Apr 25 15:48:45 devstack sudo[84021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:45 devstack sudo[84020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca Apr 25 15:48:45 devstack sudo[84020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:46 devstack sudo[84021]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7262a648-200d-40e7-8114-f755e2524bcc tempest-GroupSnapshotsTest-536830151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-88091394-ec1e-421a-bc7f-36f941de3190" returned: 0 in 0.991s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7262a648-200d-40e7-8114-f755e2524bcc tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-88091394-ec1e-421a-bc7f-36f941de3190 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:46 devstack sudo[84030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-88091394-ec1e-421a-bc7f-36f941de3190 Apr 25 15:48:46 devstack sudo[84030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:46 devstack sudo[84020]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-99b171ca-913a-4863-b972-700ec3e855b1 tempest-SnapshotsActionsTest-549497535 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca" returned: 0 in 1.307s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-99b171ca-913a-4863-b972-700ec3e855b1 tempest-SnapshotsActionsTest-549497535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:46 devstack sudo[84032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca Apr 25 15:48:46 devstack sudo[84032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:47 devstack sudo[84030]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7262a648-200d-40e7-8114-f755e2524bcc tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-88091394-ec1e-421a-bc7f-36f941de3190" returned: 0 in 0.980s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:47 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7262a648-200d-40e7-8114-f755e2524bcc tempest-GroupSnapshotsTest-536830151 None] Lock "cinder-quobyte-88091394-ec1e-421a-bc7f-36f941de3190" released by "delete_volume" :: held 2.048s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:48:47 devstack sudo[84032]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:47 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-7262a648-200d-40e7-8114-f755e2524bcc tempest-GroupSnapshotsTest-536830151 None] Created reservations ['a55ee3ac-d8a1-4f19-8823-d9d770a08356'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:48:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-99b171ca-913a-4863-b972-700ec3e855b1 tempest-SnapshotsActionsTest-549497535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c133976-dc67-47d4-b1e8-dc68fb41f2ca" returned: 0 in 1.050s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:47 devstack cinder-volume[81828]: WARNING cinder.quota [None req-7262a648-200d-40e7-8114-f755e2524bcc tempest-GroupSnapshotsTest-536830151 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-493842651 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-493842651, it is now deprecated. Please use the default quota class for default quota. Apr 25 15:48:47 devstack cinder-volume[81828]: WARNING cinder.quota [None req-7262a648-200d-40e7-8114-f755e2524bcc tempest-GroupSnapshotsTest-536830151 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-493842651 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-493842651, it is now deprecated. Please use the default quota class for default quota. Apr 25 15:48:47 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-99b171ca-913a-4863-b972-700ec3e855b1 tempest-SnapshotsActionsTest-549497535 None] Lock "cinder-quobyte-8c133976-dc67-47d4-b1e8-dc68fb41f2ca" released by "delete_volume" :: held 2.472s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:48:47 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-7262a648-200d-40e7-8114-f755e2524bcc tempest-GroupSnapshotsTest-536830151 None] Created reservations ['173a0916-48ad-4939-86b9-51474feaec0a', '4de7fe9b-1e4c-4a15-84e9-26e52e1f98e2', 'b17ff01f-f2d1-4c9a-8d13-b3bf5e52c032', '826ed7c4-5acf-49e1-9a1c-a8ddec423854'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:48:47 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-99b171ca-913a-4863-b972-700ec3e855b1 tempest-SnapshotsActionsTest-549497535 None] Created reservations ['377259a5-3791-4e1e-aa83-ba4e43f75802', 'f1a92342-9c50-4e66-82df-9834344a34b3', '8d969f73-01a3-474e-aaf0-e083bba5ad79', '86d55be1-cf2b-4ac1-835e-e368fade4715'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:48:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7262a648-200d-40e7-8114-f755e2524bcc tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:48:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7262a648-200d-40e7-8114-f755e2524bcc tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:48:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-7262a648-200d-40e7-8114-f755e2524bcc tempest-GroupSnapshotsTest-536830151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:48:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-7262a648-200d-40e7-8114-f755e2524bcc tempest-GroupSnapshotsTest-536830151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:48:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7262a648-200d-40e7-8114-f755e2524bcc tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:48:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7262a648-200d-40e7-8114-f755e2524bcc tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-99b171ca-913a-4863-b972-700ec3e855b1 tempest-SnapshotsActionsTest-549497535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:48:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-99b171ca-913a-4863-b972-700ec3e855b1 tempest-SnapshotsActionsTest-549497535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:48:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-99b171ca-913a-4863-b972-700ec3e855b1 tempest-SnapshotsActionsTest-549497535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:48:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-99b171ca-913a-4863-b972-700ec3e855b1 tempest-SnapshotsActionsTest-549497535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:48:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-99b171ca-913a-4863-b972-700ec3e855b1 tempest-SnapshotsActionsTest-549497535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:48:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-99b171ca-913a-4863-b972-700ec3e855b1 tempest-SnapshotsActionsTest-549497535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:47 devstack sudo[84153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:48:47 devstack sudo[84153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:47 devstack sudo[84154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:48:47 devstack sudo[84154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:48 devstack sudo[84153]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7262a648-200d-40e7-8114-f755e2524bcc tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.468s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:48 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-7262a648-200d-40e7-8114-f755e2524bcc tempest-GroupSnapshotsTest-536830151 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:48:48 devstack sudo[84154]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:48 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-7262a648-200d-40e7-8114-f755e2524bcc tempest-GroupSnapshotsTest-536830151 None] Delete group completed successfully. Apr 25 15:48:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-99b171ca-913a-4863-b972-700ec3e855b1 tempest-SnapshotsActionsTest-549497535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.474s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:48 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-99b171ca-913a-4863-b972-700ec3e855b1 tempest-SnapshotsActionsTest-549497535 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:48:48 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-99b171ca-913a-4863-b972-700ec3e855b1 tempest-SnapshotsActionsTest-549497535 None] Deleted volume successfully. Apr 25 15:48:48 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-99b171ca-913a-4863-b972-700ec3e855b1 tempest-SnapshotsActionsTest-549497535 None] Lock "cinder-8c133976-dc67-47d4-b1e8-dc68fb41f2ca-delete_volume" released by "delete_volume" :: held 3.364s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:48:48 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-fa5a51db-bbf8-4bd1-92fe-c64217d2cce8 tempest-GroupSnapshotsTest-536830151 None] group_snapshot 4e8da4b6-7125-4d03-a142-215a9499b048: deleting Apr 25 15:48:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fa5a51db-bbf8-4bd1-92fe-c64217d2cce8 tempest-GroupSnapshotsTest-536830151 None] group_snapshot 4e8da4b6-7125-4d03-a142-215a9499b048: deleting {{(pid=81828) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 25 15:48:48 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fa5a51db-bbf8-4bd1-92fe-c64217d2cce8 tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "cinder-quobyte-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:48:48 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fa5a51db-bbf8-4bd1-92fe-c64217d2cce8 tempest-GroupSnapshotsTest-536830151 None] Lock "cinder-quobyte-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:48:48 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fa5a51db-bbf8-4bd1-92fe-c64217d2cce8 tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "cinder-quobyte-d38831cb-6df2-4cda-8118-a7bd7d309963" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:48:48 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fa5a51db-bbf8-4bd1-92fe-c64217d2cce8 tempest-GroupSnapshotsTest-536830151 None] Lock "cinder-quobyte-d38831cb-6df2-4cda-8118-a7bd7d309963" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:48:48 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-fa5a51db-bbf8-4bd1-92fe-c64217d2cce8 tempest-GroupSnapshotsTest-536830151 None] Deleting offline snapshot d38831cb-6df2-4cda-8118-a7bd7d309963 of volume e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 15:48:48 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-fa5a51db-bbf8-4bd1-92fe-c64217d2cce8 tempest-GroupSnapshotsTest-536830151 None] snapshot_file for this snap is: volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6.d38831cb-6df2-4cda-8118-a7bd7d309963 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 15:48:48 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5a253e-1f44-4292-b04b-e3142451f0f6]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:48:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fa5a51db-bbf8-4bd1-92fe-c64217d2cce8 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6.d38831cb-6df2-4cda-8118-a7bd7d309963 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:48 devstack sudo[84163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6.d38831cb-6df2-4cda-8118-a7bd7d309963 Apr 25 15:48:48 devstack sudo[84163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:49 devstack sudo[84163]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fa5a51db-bbf8-4bd1-92fe-c64217d2cce8 tempest-GroupSnapshotsTest-536830151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6.d38831cb-6df2-4cda-8118-a7bd7d309963" returned: 0 in 0.629s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:49 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-fa5a51db-bbf8-4bd1-92fe-c64217d2cce8 tempest-GroupSnapshotsTest-536830151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:48:49 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[41273997-2aa2-417c-9a76-aecc5f29d279]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:48:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fa5a51db-bbf8-4bd1-92fe-c64217d2cce8 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:49 devstack sudo[84168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6 Apr 25 15:48:49 devstack sudo[84168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:50 devstack sudo[84168]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fa5a51db-bbf8-4bd1-92fe-c64217d2cce8 tempest-GroupSnapshotsTest-536830151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6" returned: 0 in 0.736s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fa5a51db-bbf8-4bd1-92fe-c64217d2cce8 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6.d38831cb-6df2-4cda-8118-a7bd7d309963 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:50 devstack sudo[84489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6.d38831cb-6df2-4cda-8118-a7bd7d309963 Apr 25 15:48:50 devstack sudo[84489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:51 devstack sudo[84489]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fa5a51db-bbf8-4bd1-92fe-c64217d2cce8 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6.d38831cb-6df2-4cda-8118-a7bd7d309963" returned: 0 in 0.899s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fa5a51db-bbf8-4bd1-92fe-c64217d2cce8 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6.d38831cb-6df2-4cda-8118-a7bd7d309963 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:51 devstack sudo[84514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6.d38831cb-6df2-4cda-8118-a7bd7d309963 Apr 25 15:48:51 devstack sudo[84514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:51 devstack sudo[84514]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fa5a51db-bbf8-4bd1-92fe-c64217d2cce8 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6.d38831cb-6df2-4cda-8118-a7bd7d309963" returned: 0 in 0.638s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:51 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fa5a51db-bbf8-4bd1-92fe-c64217d2cce8 tempest-GroupSnapshotsTest-536830151 None] Lock "cinder-quobyte-d38831cb-6df2-4cda-8118-a7bd7d309963" released by "_delete_snapshot" :: held 3.052s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:48:51 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fa5a51db-bbf8-4bd1-92fe-c64217d2cce8 tempest-GroupSnapshotsTest-536830151 None] Lock "cinder-quobyte-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6" released by "delete_snapshot" :: held 3.092s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:48:51 devstack cinder-volume[81828]: WARNING cinder.quota [None req-fa5a51db-bbf8-4bd1-92fe-c64217d2cce8 tempest-GroupSnapshotsTest-536830151 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-493842651 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-493842651, it is now deprecated. Please use the default quota class for default quota. Apr 25 15:48:51 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-fa5a51db-bbf8-4bd1-92fe-c64217d2cce8 tempest-GroupSnapshotsTest-536830151 None] Created reservations ['7a146a3c-4084-40d1-ae1a-137c87f0a76f', 'a0193798-55ee-483e-a059-79ab9c992f54', '3a122ab6-0b63-41fd-a4e6-d086458aaf7e', '637b5e53-0618-485f-a9a5-0be05491dbf5'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:48:52 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-fa5a51db-bbf8-4bd1-92fe-c64217d2cce8 tempest-GroupSnapshotsTest-536830151 None] group_snapshot 4e8da4b6-7125-4d03-a142-215a9499b048: deleted successfully Apr 25 15:48:53 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-19184d99-5d97-464d-83f8-32ef43748808 tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "cinder-quobyte-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:48:53 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-19184d99-5d97-464d-83f8-32ef43748808 tempest-GroupSnapshotsTest-536830151 None] Lock "cinder-quobyte-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6" acquired by "delete_volume" :: waited 0.017s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:48:53 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[79b39d5c-b125-4e14-8e1d-6cc6ba900394]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:48:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-19184d99-5d97-464d-83f8-32ef43748808 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:53 devstack sudo[84570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6 Apr 25 15:48:53 devstack sudo[84570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:54 devstack sudo[84570]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-19184d99-5d97-464d-83f8-32ef43748808 tempest-GroupSnapshotsTest-536830151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6" returned: 0 in 0.680s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-19184d99-5d97-464d-83f8-32ef43748808 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:54 devstack sudo[84584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6 Apr 25 15:48:54 devstack sudo[84584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:54 devstack sudo[84584]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-19184d99-5d97-464d-83f8-32ef43748808 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6" returned: 0 in 0.839s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:54 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-19184d99-5d97-464d-83f8-32ef43748808 tempest-GroupSnapshotsTest-536830151 None] Lock "cinder-quobyte-e04dc188-a6a9-4a3d-921d-8c5b7d28dfe6" released by "delete_volume" :: held 1.606s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:48:55 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-19184d99-5d97-464d-83f8-32ef43748808 tempest-GroupSnapshotsTest-536830151 None] Created reservations ['374e865e-775e-415e-8c3a-5821b72313be'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:48:55 devstack cinder-volume[81828]: WARNING cinder.db.sqlalchemy.api [None req-19184d99-5d97-464d-83f8-32ef43748808 tempest-GroupSnapshotsTest-536830151 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-493842651'] Apr 25 15:48:55 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-19184d99-5d97-464d-83f8-32ef43748808 tempest-GroupSnapshotsTest-536830151 None] Created reservations ['da202d16-b38c-4200-a133-5f6a014092a3', 'bc4f0b08-2600-4283-b771-9d9639934697', '4de51bfa-3cf7-4ab8-9bec-99b45568122d', 'ca5136f2-8c3e-4903-8598-1ee1679f4f09'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:48:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-19184d99-5d97-464d-83f8-32ef43748808 tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:48:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-19184d99-5d97-464d-83f8-32ef43748808 tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:48:55 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-19184d99-5d97-464d-83f8-32ef43748808 tempest-GroupSnapshotsTest-536830151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:48:55 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-19184d99-5d97-464d-83f8-32ef43748808 tempest-GroupSnapshotsTest-536830151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:48:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-19184d99-5d97-464d-83f8-32ef43748808 tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:48:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-19184d99-5d97-464d-83f8-32ef43748808 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:55 devstack sudo[84617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:48:55 devstack sudo[84617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:56 devstack sudo[84617]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-19184d99-5d97-464d-83f8-32ef43748808 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.809s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:56 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-19184d99-5d97-464d-83f8-32ef43748808 tempest-GroupSnapshotsTest-536830151 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:48:56 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-19184d99-5d97-464d-83f8-32ef43748808 tempest-GroupSnapshotsTest-536830151 None] Delete group completed successfully. Apr 25 15:48:56 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-5a6e85e8-947b-4ff5-8820-9db6def9e439 tempest-GroupSnapshotsTest-536830151 None] Group tempest-GroupSnapshotsTest-Group-148728633: creating Apr 25 15:48:56 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-5a6e85e8-947b-4ff5-8820-9db6def9e439 tempest-GroupSnapshotsTest-536830151 None] Group tempest-GroupSnapshotsTest-Group-148728633: created successfully Apr 25 15:48:56 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-5a6e85e8-947b-4ff5-8820-9db6def9e439 tempest-GroupSnapshotsTest-536830151 None] Create group completed successfully. Apr 25 15:48:57 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:48:57 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] Flow 'volume_create_manager' (bf058c94-f6e2-4d54-a9cd-59eaea626438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:48:57 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2856ce7-652e-43d1-8dc8-b6e195e9523c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:48:57 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2856ce7-652e-43d1-8dc8-b6e195e9523c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-929348365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=32531b8e-d55e-4937-9224-3472f964da17,host='devstack@QuobyteHD#QuobyteHD',id=6c5a5f27-a739-4149-aa24-0b9ebe09c6c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fce156ffabb4b57aef047b587bf194d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:48:58Z,use_quota=True,user_id='aaefbbda6ecb422bb0daaaad82e2752a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd250f8e-3455-4efa-a999-2c616019ca8f),volume_type_id=fd250f8e-3455-4efa-a999-2c616019ca8f)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:48:57 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36750b51-31b0-4c44-983f-10ce6ac5dadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:48:57 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36750b51-31b0-4c44-983f-10ce6ac5dadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:48:57 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54bae6d-4f33-4ef2-b0c5-7d0d6ba25dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:48:57 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54bae6d-4f33-4ef2-b0c5-7d0d6ba25dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c5a5f27-a739-4149-aa24-0b9ebe09c6c5', 'volume_name': 'volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:48:57 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb7d5c4-be95-4d94-abbb-7aa41df59041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:48:57 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afb7d5c4-be95-4d94-abbb-7aa41df59041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:48:57 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da6253d1-4e3f-4ee5-981c-4d38b02c9d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:48:57 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] Volume 6c5a5f27-a739-4149-aa24-0b9ebe09c6c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5', 'volume_size': 1} Apr 25 15:48:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:48:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:48:57 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=32531b8e-d55e-4937-9224-3472f964da17,created_at=2026-04-25T13:48:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-929348365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=32531b8e-d55e-4937-9224-3472f964da17,host='devstack@QuobyteHD#QuobyteHD',id=6c5a5f27-a739-4149-aa24-0b9ebe09c6c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fce156ffabb4b57aef047b587bf194d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:48:58Z,use_quota=True,user_id='aaefbbda6ecb422bb0daaaad82e2752a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd250f8e-3455-4efa-a999-2c616019ca8f),volume_type_id=fd250f8e-3455-4efa-a999-2c616019ca8f)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:48:57 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] Creating volume 6c5a5f27-a739-4149-aa24-0b9ebe09c6c5 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:48:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:48:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:48:57 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:48:57 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:48:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:48:57 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:48:57 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:48:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:57 devstack sudo[84623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5 1073741824 Apr 25 15:48:57 devstack sudo[84623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:58 devstack sudo[84623]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5 1073741824" returned: 0 in 0.890s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:48:58 devstack sudo[84629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5 Apr 25 15:48:58 devstack sudo[84629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:48:59 devstack sudo[84629]: pam_unix(sudo:session): session closed for user root Apr 25 15:48:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5" returned: 0 in 0.589s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:48:59 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:48:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:48:59 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da6253d1-4e3f-4ee5-981c-4d38b02c9d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:48:59 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4703e16f-f165-4494-a907-f52650104e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:48:59 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] Volume volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5 (6c5a5f27-a739-4149-aa24-0b9ebe09c6c5): created successfully Apr 25 15:48:59 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4703e16f-f165-4494-a907-f52650104e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:48:59 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] Flow 'volume_create_manager' (bf058c94-f6e2-4d54-a9cd-59eaea626438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:48:59 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-78df727a-8fed-4319-8f6d-5d7b4c294526 tempest-GroupSnapshotsTest-536830151 None] Created volume successfully. Apr 25 15:49:00 devstack cinder-volume[81828]: DEBUG oslo_service.periodic_task [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81828) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 25 15:49:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:49:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:49:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:49:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:49:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:49:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:00 devstack sudo[84663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:49:00 devstack sudo[84663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:00 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:49:00 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] Flow 'volume_create_manager' (c69513ba-4f56-4621-97dd-2ea7078b5c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:49:00 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c233ef3-5d95-4da4-830f-37a64facd21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:00 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c233ef3-5d95-4da4-830f-37a64facd21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-446773602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=32531b8e-d55e-4937-9224-3472f964da17,host='devstack@QuobyteHD#QuobyteHD',id=22f1d530-9758-4b28-a6d5-76a809e801b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fce156ffabb4b57aef047b587bf194d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:49:01Z,use_quota=True,user_id='aaefbbda6ecb422bb0daaaad82e2752a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd250f8e-3455-4efa-a999-2c616019ca8f),volume_type_id=fd250f8e-3455-4efa-a999-2c616019ca8f)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:00 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583b4279-8ad9-40e6-9b13-572cf1554200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:00 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (583b4279-8ad9-40e6-9b13-572cf1554200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:00 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a44f896c-7014-4a92-9724-e94c59fa71e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:00 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a44f896c-7014-4a92-9724-e94c59fa71e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22f1d530-9758-4b28-a6d5-76a809e801b1', 'volume_name': 'volume-22f1d530-9758-4b28-a6d5-76a809e801b1', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:00 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a3c6d9f-8ef3-433d-8837-461c3d03be6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:00 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a3c6d9f-8ef3-433d-8837-461c3d03be6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:00 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c47288f-9232-4555-bc45-cc8e4230b46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:00 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] Volume 22f1d530-9758-4b28-a6d5-76a809e801b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22f1d530-9758-4b28-a6d5-76a809e801b1', 'volume_size': 1} Apr 25 15:49:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:49:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:49:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=32531b8e-d55e-4937-9224-3472f964da17,created_at=2026-04-25T13:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-446773602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=32531b8e-d55e-4937-9224-3472f964da17,host='devstack@QuobyteHD#QuobyteHD',id=22f1d530-9758-4b28-a6d5-76a809e801b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fce156ffabb4b57aef047b587bf194d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:49:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:49:01Z,use_quota=True,user_id='aaefbbda6ecb422bb0daaaad82e2752a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fd250f8e-3455-4efa-a999-2c616019ca8f),volume_type_id=fd250f8e-3455-4efa-a999-2c616019ca8f)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:49:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] Creating volume 22f1d530-9758-4b28-a6d5-76a809e801b1 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:49:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:49:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:49:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:49:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:49:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:49:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:49:00 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:49:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:00 devstack sudo[84665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1 1073741824 Apr 25 15:49:00 devstack sudo[84665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:00 devstack sudo[84663]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.634s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:00 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:49:01 devstack sudo[84665]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1 1073741824" returned: 0 in 0.856s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:01 devstack sudo[84681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1 Apr 25 15:49:01 devstack sudo[84681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:02 devstack sudo[84681]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1" returned: 0 in 0.669s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:02 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:49:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:49:02 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c47288f-9232-4555-bc45-cc8e4230b46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22f1d530-9758-4b28-a6d5-76a809e801b1', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:02 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54ff3985-fb40-42f1-83ed-9c918d978b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:02 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] Volume volume-22f1d530-9758-4b28-a6d5-76a809e801b1 (22f1d530-9758-4b28-a6d5-76a809e801b1): created successfully Apr 25 15:49:02 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54ff3985-fb40-42f1-83ed-9c918d978b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:02 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] Flow 'volume_create_manager' (c69513ba-4f56-4621-97dd-2ea7078b5c73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:49:02 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-df0f2849-b771-4f76-8aab-8cd2c9d7fac1 tempest-GroupSnapshotsTest-536830151 None] Created volume successfully. Apr 25 15:49:03 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-2c6cddfe-95b4-4e12-8eda-743793456da4 tempest-GroupSnapshotsTest-536830151 None] Update group completed successfully. Apr 25 15:49:04 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-91a10355-c624-4582-a2bd-8acc26f784a5 tempest-GroupSnapshotsTest-536830151 None] Update group completed successfully. Apr 25 15:49:05 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-40e9fccd-c78f-4d6d-b4c4-1143df407901 tempest-GroupSnapshotsTest-536830151 None] Update group completed successfully. Apr 25 15:49:06 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:49:06 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] Flow 'volume_create_manager' (62513934-84c9-423e-b94c-8992ea5e7c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:49:06 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe2a1ee0-bd81-4ad4-a373-39d3299a87db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:06 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe2a1ee0-bd81-4ad4-a373-39d3299a87db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1578551723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=030858e4-9009-4aa4-a154-481ad427953d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f1acbcf1184acebbef0aa869f275f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:49:06Z,use_quota=True,user_id='9c3807db700241af87d6a73eea55a052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:06 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03bc20f2-0b12-45d9-a8e9-93f9df71a6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:06 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03bc20f2-0b12-45d9-a8e9-93f9df71a6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:06 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a545c5f-b094-4b0a-a0d3-bef0297559a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:06 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a545c5f-b094-4b0a-a0d3-bef0297559a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '030858e4-9009-4aa4-a154-481ad427953d', 'volume_name': 'volume-030858e4-9009-4aa4-a154-481ad427953d', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:06 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a12afe1-7b1a-4c82-8d0c-ec60e54461d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:06 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a12afe1-7b1a-4c82-8d0c-ec60e54461d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:06 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a54cbb2d-486c-44c4-b00b-bb4d2c2fb64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:06 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] Volume 030858e4-9009-4aa4-a154-481ad427953d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-030858e4-9009-4aa4-a154-481ad427953d', 'volume_size': 1} Apr 25 15:49:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:49:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:49:06 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:49:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1578551723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=030858e4-9009-4aa4-a154-481ad427953d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f1acbcf1184acebbef0aa869f275f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:49:06Z,use_quota=True,user_id='9c3807db700241af87d6a73eea55a052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:49:06 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] Creating volume 030858e4-9009-4aa4-a154-481ad427953d {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:49:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:49:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:49:06 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:49:06 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:49:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:49:06 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:49:06 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:49:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-030858e4-9009-4aa4-a154-481ad427953d 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:06 devstack sudo[84722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-030858e4-9009-4aa4-a154-481ad427953d 1073741824 Apr 25 15:49:06 devstack sudo[84722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:06 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-d2013430-f788-42d3-b4f9-4df872694af8 tempest-GroupSnapshotsTest-536830151 None] Update group completed successfully. Apr 25 15:49:07 devstack sudo[84722]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-030858e4-9009-4aa4-a154-481ad427953d 1073741824" returned: 0 in 0.755s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-030858e4-9009-4aa4-a154-481ad427953d {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:07 devstack sudo[84753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-030858e4-9009-4aa4-a154-481ad427953d Apr 25 15:49:07 devstack sudo[84753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:07 devstack sudo[84753]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-030858e4-9009-4aa4-a154-481ad427953d" returned: 0 in 0.485s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:07 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:49:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:49:07 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a54cbb2d-486c-44c4-b00b-bb4d2c2fb64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-030858e4-9009-4aa4-a154-481ad427953d', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:07 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b600273-9d99-4cc1-ad00-90f251157ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:07 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] Volume volume-030858e4-9009-4aa4-a154-481ad427953d (030858e4-9009-4aa4-a154-481ad427953d): created successfully Apr 25 15:49:07 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b600273-9d99-4cc1-ad00-90f251157ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:07 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] Flow 'volume_create_manager' (62513934-84c9-423e-b94c-8992ea5e7c78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:49:07 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-166f48e4-148d-43db-a4a7-57c97d85b9e3 tempest-ServersNegativeTestJSON-2079024930 None] Created volume successfully. Apr 25 15:49:08 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] GroupSnapshot a25373a5-0e2a-42d5-a3ee-741c1721f285: creating. Apr 25 15:49:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] Group snapshot a25373a5-0e2a-42d5-a3ee-741c1721f285: creating. {{(pid=81828) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 25 15:49:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:49:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:49:08 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] Creating offline snapshot 2985dce9-6ebc-4cf6-bd65-7d8b92de90d6 of volume 22f1d530-9758-4b28-a6d5-76a809e801b1 {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 15:49:08 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c9b8f0-77c4-4362-a743-a691413e3baf]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:49:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:08 devstack sudo[84756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1 Apr 25 15:49:08 devstack sudo[84756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:09 devstack sudo[84756]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1" returned: 0 in 0.864s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1.2985dce9-6ebc-4cf6-bd65-7d8b92de90d6 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:09 devstack sudo[84801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1.2985dce9-6ebc-4cf6-bd65-7d8b92de90d6 1G Apr 25 15:49:09 devstack sudo[84801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:09 devstack sudo[84801]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1.2985dce9-6ebc-4cf6-bd65-7d8b92de90d6 1G" returned: 0 in 0.912s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22f1d530-9758-4b28-a6d5-76a809e801b1 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1.2985dce9-6ebc-4cf6-bd65-7d8b92de90d6 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:10 devstack sudo[84830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22f1d530-9758-4b28-a6d5-76a809e801b1 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1.2985dce9-6ebc-4cf6-bd65-7d8b92de90d6 Apr 25 15:49:10 devstack sudo[84830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:10 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:49:10 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] Flow 'volume_create_manager' (37f978b6-3a9c-498a-b9d3-60e5c18896eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:49:10 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bbdb8da-b4b1-46c3-b32b-c83b8a44feed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:10 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bbdb8da-b4b1-46c3-b32b-c83b8a44feed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-751160753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75996c88-6bc9-4ae4-9cfe-6e28e9d605b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f1acbcf1184acebbef0aa869f275f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:49:10Z,use_quota=True,user_id='9c3807db700241af87d6a73eea55a052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:10 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a76884af-c3f8-48ec-9e88-497c3eb2e1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:10 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a76884af-c3f8-48ec-9e88-497c3eb2e1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:10 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab9ddb5-4c36-47da-846f-7dbb23aa8e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:10 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab9ddb5-4c36-47da-846f-7dbb23aa8e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75996c88-6bc9-4ae4-9cfe-6e28e9d605b7', 'volume_name': 'volume-75996c88-6bc9-4ae4-9cfe-6e28e9d605b7', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:10 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a10d2c52-ece4-4d39-b588-60c740aa88f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:10 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a10d2c52-ece4-4d39-b588-60c740aa88f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:10 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a91c2d9-4e12-43c2-9464-cff8b08207c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:10 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] Volume 75996c88-6bc9-4ae4-9cfe-6e28e9d605b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75996c88-6bc9-4ae4-9cfe-6e28e9d605b7', 'volume_size': 1} Apr 25 15:49:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:49:10 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:49:10 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] Flow 'volume_create_manager' (fbac1da4-12d5-499c-b386-9526fe4c49bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:49:10 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a3ffc66-fae0-4b8d-ad4b-b4e0f63e6855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:10 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a3ffc66-fae0-4b8d-ad4b-b4e0f63e6855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-173314780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b959ef8-4f4e-4711-ab17-33442b067571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='593e99b159244123930ec1c0927d4734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:49:10Z,use_quota=True,user_id='7298d3a5590e4699abd01c7e94f91a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:10 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391ecb11-9adc-4e33-a810-c3215aaf3060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:10 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391ecb11-9adc-4e33-a810-c3215aaf3060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:10 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9fd787-329a-492f-947e-c3f950c5a9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:10 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9fd787-329a-492f-947e-c3f950c5a9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b959ef8-4f4e-4711-ab17-33442b067571', 'volume_name': 'volume-8b959ef8-4f4e-4711-ab17-33442b067571', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:10 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d45cffae-c9e9-45aa-bd4b-e97eec42a816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:10 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d45cffae-c9e9-45aa-bd4b-e97eec42a816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:10 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf84ef33-f687-4719-81d2-1fe2554d1c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:10 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] Volume 8b959ef8-4f4e-4711-ab17-33442b067571: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b959ef8-4f4e-4711-ab17-33442b067571', 'volume_size': 1} Apr 25 15:49:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:49:10 devstack sudo[84830]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22f1d530-9758-4b28-a6d5-76a809e801b1 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1.2985dce9-6ebc-4cf6-bd65-7d8b92de90d6" returned: 0 in 0.785s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:10 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1.2985dce9-6ebc-4cf6-bd65-7d8b92de90d6 is being set with open permissions: ugo+rw: NotImplementedError Apr 25 15:49:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1.2985dce9-6ebc-4cf6-bd65-7d8b92de90d6 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:10 devstack sudo[84851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1.2985dce9-6ebc-4cf6-bd65-7d8b92de90d6 Apr 25 15:49:10 devstack sudo[84851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:11 devstack sudo[84851]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1.2985dce9-6ebc-4cf6-bd65-7d8b92de90d6" returned: 0 in 0.490s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:11 devstack sudo[84856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1.info Apr 25 15:49:11 devstack sudo[84856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:11 devstack sudo[84856]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1.info" returned: 0 in 0.502s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:11 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1.info is being set with open permissions: ugo+rw: NotImplementedError Apr 25 15:49:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:11 devstack sudo[84859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1.info Apr 25 15:49:11 devstack sudo[84859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:12 devstack sudo[84859]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1.info" returned: 0 in 0.526s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.170s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:49:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:49:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:49:12 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] Creating offline snapshot ffc33431-88b9-4462-95c0-1ec31aedd0f7 of volume 6c5a5f27-a739-4149-aa24-0b9ebe09c6c5 {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 15:49:12 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a80002-3e36-4061-a9d1-946b7203696d]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:49:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:12 devstack sudo[84863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5 Apr 25 15:49:12 devstack sudo[84863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:12 devstack sudo[84863]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5" returned: 0 in 0.540s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5.ffc33431-88b9-4462-95c0-1ec31aedd0f7 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:12 devstack sudo[84869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5.ffc33431-88b9-4462-95c0-1ec31aedd0f7 1G Apr 25 15:49:12 devstack sudo[84869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:13 devstack sudo[84869]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5.ffc33431-88b9-4462-95c0-1ec31aedd0f7 1G" returned: 0 in 0.751s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5.ffc33431-88b9-4462-95c0-1ec31aedd0f7 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:13 devstack sudo[84874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5.ffc33431-88b9-4462-95c0-1ec31aedd0f7 Apr 25 15:49:13 devstack sudo[84874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:14 devstack sudo[84874]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5.ffc33431-88b9-4462-95c0-1ec31aedd0f7" returned: 0 in 0.489s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:14 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5.ffc33431-88b9-4462-95c0-1ec31aedd0f7 is being set with open permissions: ugo+rw: NotImplementedError Apr 25 15:49:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5.ffc33431-88b9-4462-95c0-1ec31aedd0f7 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:14 devstack sudo[84879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5.ffc33431-88b9-4462-95c0-1ec31aedd0f7 Apr 25 15:49:14 devstack sudo[84879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:14 devstack sudo[84879]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5.ffc33431-88b9-4462-95c0-1ec31aedd0f7" returned: 0 in 0.529s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:14 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:SELECT=98,cinder:INSERT=18,cinder:UPDATE=101,cinder:DELETE=3 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:49:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:14 devstack sudo[84892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5.info Apr 25 15:49:14 devstack sudo[84892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:15 devstack sudo[84892]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5.info" returned: 0 in 0.552s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:15 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5.info is being set with open permissions: ugo+rw: NotImplementedError Apr 25 15:49:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:15 devstack sudo[84915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5.info Apr 25 15:49:15 devstack sudo[84915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:15 devstack sudo[84915]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5.info" returned: 0 in 0.455s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.402s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:49:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.075s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:49:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-173314780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b959ef8-4f4e-4711-ab17-33442b067571,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='593e99b159244123930ec1c0927d4734',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:49:10Z,use_quota=True,user_id='7298d3a5590e4699abd01c7e94f91a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:49:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] Creating volume 8b959ef8-4f4e-4711-ab17-33442b067571 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:49:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:49:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:49:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:49:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:49:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:49:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:49:15 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:49:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8b959ef8-4f4e-4711-ab17-33442b067571 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:15 devstack sudo[84922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8b959ef8-4f4e-4711-ab17-33442b067571 1073741824 Apr 25 15:49:15 devstack sudo[84922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:15 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-846eb3b3-cb22-4313-a0ff-0ce91e4a7a23 tempest-GroupSnapshotsTest-536830151 None] group_snapshot a25373a5-0e2a-42d5-a3ee-741c1721f285: created successfully Apr 25 15:49:16 devstack sudo[84922]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8b959ef8-4f4e-4711-ab17-33442b067571 1073741824" returned: 0 in 0.640s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8b959ef8-4f4e-4711-ab17-33442b067571 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:16 devstack sudo[84934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8b959ef8-4f4e-4711-ab17-33442b067571 Apr 25 15:49:16 devstack sudo[84934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:16 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] group_snapshot a25373a5-0e2a-42d5-a3ee-741c1721f285: deleting Apr 25 15:49:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] group_snapshot a25373a5-0e2a-42d5-a3ee-741c1721f285: deleting {{(pid=81828) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 25 15:49:16 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "cinder-quobyte-22f1d530-9758-4b28-a6d5-76a809e801b1" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:49:16 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] Lock "cinder-quobyte-22f1d530-9758-4b28-a6d5-76a809e801b1" acquired by "delete_snapshot" :: waited 0.027s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:49:16 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "cinder-quobyte-2985dce9-6ebc-4cf6-bd65-7d8b92de90d6" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:49:16 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] Lock "cinder-quobyte-2985dce9-6ebc-4cf6-bd65-7d8b92de90d6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:49:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] Deleting offline snapshot 2985dce9-6ebc-4cf6-bd65-7d8b92de90d6 of volume 22f1d530-9758-4b28-a6d5-76a809e801b1 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 15:49:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] snapshot_file for this snap is: volume-22f1d530-9758-4b28-a6d5-76a809e801b1.2985dce9-6ebc-4cf6-bd65-7d8b92de90d6 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 15:49:16 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d36b3e-ce25-452a-b64b-3bdfe17bd8fa]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:49:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1.2985dce9-6ebc-4cf6-bd65-7d8b92de90d6 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:16 devstack sudo[84940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1.2985dce9-6ebc-4cf6-bd65-7d8b92de90d6 Apr 25 15:49:16 devstack sudo[84940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:17 devstack sudo[84934]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8b959ef8-4f4e-4711-ab17-33442b067571" returned: 0 in 0.720s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:17 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] <== create_volume: return (1431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:49:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:49:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:49:17 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:49:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-751160753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75996c88-6bc9-4ae4-9cfe-6e28e9d605b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f1acbcf1184acebbef0aa869f275f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:49:10Z,use_quota=True,user_id='9c3807db700241af87d6a73eea55a052',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:49:17 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] Creating volume 75996c88-6bc9-4ae4-9cfe-6e28e9d605b7 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:49:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:49:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:49:17 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:49:17 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:49:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:49:17 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:49:17 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:49:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-75996c88-6bc9-4ae4-9cfe-6e28e9d605b7 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:17 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf84ef33-f687-4719-81d2-1fe2554d1c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b959ef8-4f4e-4711-ab17-33442b067571', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:17 devstack sudo[84957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-75996c88-6bc9-4ae4-9cfe-6e28e9d605b7 1073741824 Apr 25 15:49:17 devstack sudo[84957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:17 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44e43e2e-f32f-476f-a5c7-9170957727a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:17 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] Volume volume-8b959ef8-4f4e-4711-ab17-33442b067571 (8b959ef8-4f4e-4711-ab17-33442b067571): created successfully Apr 25 15:49:17 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44e43e2e-f32f-476f-a5c7-9170957727a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:17 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] Flow 'volume_create_manager' (fbac1da4-12d5-499c-b386-9526fe4c49bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:49:17 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-a0b1c988-a283-4392-8831-5db4f643597d tempest-VolumesServicesTestJSON-231937063 None] Created volume successfully. Apr 25 15:49:17 devstack sudo[84940]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1.2985dce9-6ebc-4cf6-bd65-7d8b92de90d6" returned: 0 in 0.884s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:17 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22f1d530-9758-4b28-a6d5-76a809e801b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:49:17 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[869eafcc-61fd-47f8-ad39-d89c341d85f2]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:49:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:17 devstack sudo[84977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1 Apr 25 15:49:17 devstack sudo[84977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:18 devstack sudo[84957]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-75996c88-6bc9-4ae4-9cfe-6e28e9d605b7 1073741824" returned: 0 in 0.917s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:18 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-57b7af99-ec80-418b-aa6b-3899e709a695 tempest-VolumesServicesTestJSON-231937063 None] Acquiring lock "cinder-8b959ef8-4f4e-4711-ab17-33442b067571-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:49:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-75996c88-6bc9-4ae4-9cfe-6e28e9d605b7 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:18 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-57b7af99-ec80-418b-aa6b-3899e709a695 tempest-VolumesServicesTestJSON-231937063 None] Lock "cinder-8b959ef8-4f4e-4711-ab17-33442b067571-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:49:18 devstack sudo[84984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-75996c88-6bc9-4ae4-9cfe-6e28e9d605b7 Apr 25 15:49:18 devstack sudo[84984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:18 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-57b7af99-ec80-418b-aa6b-3899e709a695 tempest-VolumesServicesTestJSON-231937063 None] Acquiring lock "cinder-quobyte-8b959ef8-4f4e-4711-ab17-33442b067571" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:49:18 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-57b7af99-ec80-418b-aa6b-3899e709a695 tempest-VolumesServicesTestJSON-231937063 None] Lock "cinder-quobyte-8b959ef8-4f4e-4711-ab17-33442b067571" acquired by "delete_volume" :: waited 0.015s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:49:18 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[e120a9e1-6194-40ad-899f-3018d6536c07]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:49:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-57b7af99-ec80-418b-aa6b-3899e709a695 tempest-VolumesServicesTestJSON-231937063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8b959ef8-4f4e-4711-ab17-33442b067571 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:18 devstack sudo[84988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8b959ef8-4f4e-4711-ab17-33442b067571 Apr 25 15:49:18 devstack sudo[84988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:18 devstack sudo[84977]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1" returned: 0 in 0.726s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1.2985dce9-6ebc-4cf6-bd65-7d8b92de90d6 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:18 devstack sudo[84991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1.2985dce9-6ebc-4cf6-bd65-7d8b92de90d6 Apr 25 15:49:18 devstack sudo[84991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:18 devstack sudo[84984]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-75996c88-6bc9-4ae4-9cfe-6e28e9d605b7" returned: 0 in 0.800s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:18 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:49:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:49:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a91c2d9-4e12-43c2-9464-cff8b08207c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75996c88-6bc9-4ae4-9cfe-6e28e9d605b7', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05fe003e-3b7e-4fb4-a2d1-067dfdb2f44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:19 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] Volume volume-75996c88-6bc9-4ae4-9cfe-6e28e9d605b7 (75996c88-6bc9-4ae4-9cfe-6e28e9d605b7): created successfully Apr 25 15:49:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05fe003e-3b7e-4fb4-a2d1-067dfdb2f44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] Flow 'volume_create_manager' (37f978b6-3a9c-498a-b9d3-60e5c18896eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:49:19 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-49c63c58-6cf8-439f-95ce-46f1f5e8f7eb tempest-ServersNegativeTestJSON-2079024930 None] Created volume successfully. Apr 25 15:49:19 devstack sudo[84991]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1.2985dce9-6ebc-4cf6-bd65-7d8b92de90d6" returned: 0 in 0.656s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1.2985dce9-6ebc-4cf6-bd65-7d8b92de90d6 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:19 devstack sudo[85001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1.2985dce9-6ebc-4cf6-bd65-7d8b92de90d6 Apr 25 15:49:19 devstack sudo[85001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:19 devstack sudo[84988]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-57b7af99-ec80-418b-aa6b-3899e709a695 tempest-VolumesServicesTestJSON-231937063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8b959ef8-4f4e-4711-ab17-33442b067571" returned: 0 in 0.803s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-57b7af99-ec80-418b-aa6b-3899e709a695 tempest-VolumesServicesTestJSON-231937063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8b959ef8-4f4e-4711-ab17-33442b067571 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:19 devstack sudo[85003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8b959ef8-4f4e-4711-ab17-33442b067571 Apr 25 15:49:19 devstack sudo[85003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:19 devstack sudo[85001]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1.2985dce9-6ebc-4cf6-bd65-7d8b92de90d6" returned: 0 in 0.533s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:19 devstack sudo[85003]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-57b7af99-ec80-418b-aa6b-3899e709a695 tempest-VolumesServicesTestJSON-231937063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8b959ef8-4f4e-4711-ab17-33442b067571" returned: 0 in 0.517s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:19 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] Lock "cinder-quobyte-2985dce9-6ebc-4cf6-bd65-7d8b92de90d6" released by "_delete_snapshot" :: held 2.940s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:49:19 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-57b7af99-ec80-418b-aa6b-3899e709a695 tempest-VolumesServicesTestJSON-231937063 None] Lock "cinder-quobyte-8b959ef8-4f4e-4711-ab17-33442b067571" released by "delete_volume" :: held 1.368s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:49:19 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] Lock "cinder-quobyte-22f1d530-9758-4b28-a6d5-76a809e801b1" released by "delete_snapshot" :: held 2.984s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:49:19 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "cinder-quobyte-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:49:19 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] Lock "cinder-quobyte-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5" acquired by "delete_snapshot" :: waited 0.054s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:49:19 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "cinder-quobyte-ffc33431-88b9-4462-95c0-1ec31aedd0f7" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:49:19 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-57b7af99-ec80-418b-aa6b-3899e709a695 tempest-VolumesServicesTestJSON-231937063 None] Created reservations ['edbbf444-5cd8-4e61-bbda-0928bbd3b064', '04ba42f5-92e6-42a3-a282-6a212a95acdc', '53da6d36-e7e4-492f-8c2a-1c34ec7ba62d', 'cc6a17e2-93d4-4f71-9d70-0eab15b82b59'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:49:19 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] Lock "cinder-quobyte-ffc33431-88b9-4462-95c0-1ec31aedd0f7" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:49:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] Deleting offline snapshot ffc33431-88b9-4462-95c0-1ec31aedd0f7 of volume 6c5a5f27-a739-4149-aa24-0b9ebe09c6c5 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 15:49:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] snapshot_file for this snap is: volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5.ffc33431-88b9-4462-95c0-1ec31aedd0f7 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 15:49:19 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5a6c91-58c5-4676-a08f-d85d624a335e]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:49:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5.ffc33431-88b9-4462-95c0-1ec31aedd0f7 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-57b7af99-ec80-418b-aa6b-3899e709a695 tempest-VolumesServicesTestJSON-231937063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:49:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-57b7af99-ec80-418b-aa6b-3899e709a695 tempest-VolumesServicesTestJSON-231937063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:49:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-57b7af99-ec80-418b-aa6b-3899e709a695 tempest-VolumesServicesTestJSON-231937063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:49:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-57b7af99-ec80-418b-aa6b-3899e709a695 tempest-VolumesServicesTestJSON-231937063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:49:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-57b7af99-ec80-418b-aa6b-3899e709a695 tempest-VolumesServicesTestJSON-231937063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:49:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-57b7af99-ec80-418b-aa6b-3899e709a695 tempest-VolumesServicesTestJSON-231937063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:19 devstack sudo[85013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:49:19 devstack sudo[85013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:20 devstack sudo[85012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5.ffc33431-88b9-4462-95c0-1ec31aedd0f7 Apr 25 15:49:20 devstack sudo[85012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:20 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-59a3599f-7736-4384-b903-fedeaa8d0250 tempest-ServersNegativeTestJSON-2079024930 None] Acquiring lock "cinder-75996c88-6bc9-4ae4-9cfe-6e28e9d605b7-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:49:20 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-59a3599f-7736-4384-b903-fedeaa8d0250 tempest-ServersNegativeTestJSON-2079024930 None] Lock "cinder-75996c88-6bc9-4ae4-9cfe-6e28e9d605b7-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:49:20 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-59a3599f-7736-4384-b903-fedeaa8d0250 tempest-ServersNegativeTestJSON-2079024930 None] Acquiring lock "cinder-quobyte-75996c88-6bc9-4ae4-9cfe-6e28e9d605b7" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:49:20 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-59a3599f-7736-4384-b903-fedeaa8d0250 tempest-ServersNegativeTestJSON-2079024930 None] Lock "cinder-quobyte-75996c88-6bc9-4ae4-9cfe-6e28e9d605b7" acquired by "delete_volume" :: waited 0.019s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:49:20 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb50186-bdc2-4bb5-a109-2f7443de61bb]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:49:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-59a3599f-7736-4384-b903-fedeaa8d0250 tempest-ServersNegativeTestJSON-2079024930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-75996c88-6bc9-4ae4-9cfe-6e28e9d605b7 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:20 devstack sudo[85013]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-57b7af99-ec80-418b-aa6b-3899e709a695 tempest-VolumesServicesTestJSON-231937063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.599s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:20 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-57b7af99-ec80-418b-aa6b-3899e709a695 tempest-VolumesServicesTestJSON-231937063 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:49:20 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-57b7af99-ec80-418b-aa6b-3899e709a695 tempest-VolumesServicesTestJSON-231937063 None] Deleted volume successfully. Apr 25 15:49:20 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-57b7af99-ec80-418b-aa6b-3899e709a695 tempest-VolumesServicesTestJSON-231937063 None] Lock "cinder-8b959ef8-4f4e-4711-ab17-33442b067571-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:49:20 devstack sudo[85019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-75996c88-6bc9-4ae4-9cfe-6e28e9d605b7 Apr 25 15:49:20 devstack sudo[85019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:20 devstack sudo[85012]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5.ffc33431-88b9-4462-95c0-1ec31aedd0f7" returned: 0 in 0.783s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:20 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:49:20 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f22fa48-2df2-4527-bca8-51158431e041]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:49:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:20 devstack sudo[85024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5 Apr 25 15:49:20 devstack sudo[85024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:21 devstack sudo[85019]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-59a3599f-7736-4384-b903-fedeaa8d0250 tempest-ServersNegativeTestJSON-2079024930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-75996c88-6bc9-4ae4-9cfe-6e28e9d605b7" returned: 0 in 0.635s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-59a3599f-7736-4384-b903-fedeaa8d0250 tempest-ServersNegativeTestJSON-2079024930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-75996c88-6bc9-4ae4-9cfe-6e28e9d605b7 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:21 devstack sudo[85030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-75996c88-6bc9-4ae4-9cfe-6e28e9d605b7 Apr 25 15:49:21 devstack sudo[85030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:21 devstack sudo[85024]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5" returned: 0 in 0.622s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5.ffc33431-88b9-4462-95c0-1ec31aedd0f7 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:21 devstack sudo[85048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5.ffc33431-88b9-4462-95c0-1ec31aedd0f7 Apr 25 15:49:21 devstack sudo[85048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:21 devstack sudo[85030]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-59a3599f-7736-4384-b903-fedeaa8d0250 tempest-ServersNegativeTestJSON-2079024930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-75996c88-6bc9-4ae4-9cfe-6e28e9d605b7" returned: 0 in 0.509s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:21 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-59a3599f-7736-4384-b903-fedeaa8d0250 tempest-ServersNegativeTestJSON-2079024930 None] Lock "cinder-quobyte-75996c88-6bc9-4ae4-9cfe-6e28e9d605b7" released by "delete_volume" :: held 1.195s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:49:21 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-59a3599f-7736-4384-b903-fedeaa8d0250 tempest-ServersNegativeTestJSON-2079024930 None] Created reservations ['e7cecee0-6a6a-400a-aef0-36f7c820124a', 'fb064712-2994-4ed3-9996-008042e7ae0e', 'd5e0e567-6a10-4b1b-9dbe-c5285803e3da', '327d8def-d451-4940-9c09-766e54f4f68d'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:49:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-59a3599f-7736-4384-b903-fedeaa8d0250 tempest-ServersNegativeTestJSON-2079024930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:49:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-59a3599f-7736-4384-b903-fedeaa8d0250 tempest-ServersNegativeTestJSON-2079024930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:49:21 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-59a3599f-7736-4384-b903-fedeaa8d0250 tempest-ServersNegativeTestJSON-2079024930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:49:21 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-59a3599f-7736-4384-b903-fedeaa8d0250 tempest-ServersNegativeTestJSON-2079024930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:49:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-59a3599f-7736-4384-b903-fedeaa8d0250 tempest-ServersNegativeTestJSON-2079024930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:49:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-59a3599f-7736-4384-b903-fedeaa8d0250 tempest-ServersNegativeTestJSON-2079024930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:21 devstack sudo[85052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:49:21 devstack sudo[85052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:22 devstack sudo[85048]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5.ffc33431-88b9-4462-95c0-1ec31aedd0f7" returned: 0 in 0.794s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5.ffc33431-88b9-4462-95c0-1ec31aedd0f7 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:22 devstack sudo[85056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5.ffc33431-88b9-4462-95c0-1ec31aedd0f7 Apr 25 15:49:22 devstack sudo[85056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:22 devstack sudo[85052]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-59a3599f-7736-4384-b903-fedeaa8d0250 tempest-ServersNegativeTestJSON-2079024930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.539s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:22 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-59a3599f-7736-4384-b903-fedeaa8d0250 tempest-ServersNegativeTestJSON-2079024930 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:49:22 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-59a3599f-7736-4384-b903-fedeaa8d0250 tempest-ServersNegativeTestJSON-2079024930 None] Deleted volume successfully. Apr 25 15:49:22 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:SELECT=107,cinder:UPDATE=89,cinder:DELETE=7,cinder:INSERT=23 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:49:22 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-59a3599f-7736-4384-b903-fedeaa8d0250 tempest-ServersNegativeTestJSON-2079024930 None] Lock "cinder-75996c88-6bc9-4ae4-9cfe-6e28e9d605b7-delete_volume" released by "delete_volume" :: held 1.949s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:49:22 devstack sudo[85056]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5.ffc33431-88b9-4462-95c0-1ec31aedd0f7" returned: 0 in 0.509s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:22 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] Lock "cinder-quobyte-ffc33431-88b9-4462-95c0-1ec31aedd0f7" released by "_delete_snapshot" :: held 2.825s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:49:22 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] Lock "cinder-quobyte-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5" released by "delete_snapshot" :: held 2.859s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:49:22 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c40f5d4c-360a-4c9f-a8ad-855c11f80dcc tempest-ServersNegativeTestJSON-2079024930 None] Acquiring lock "cinder-030858e4-9009-4aa4-a154-481ad427953d-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:49:22 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c40f5d4c-360a-4c9f-a8ad-855c11f80dcc tempest-ServersNegativeTestJSON-2079024930 None] Lock "cinder-030858e4-9009-4aa4-a154-481ad427953d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:49:22 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c40f5d4c-360a-4c9f-a8ad-855c11f80dcc tempest-ServersNegativeTestJSON-2079024930 None] Acquiring lock "cinder-quobyte-030858e4-9009-4aa4-a154-481ad427953d" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:49:22 devstack cinder-volume[81828]: WARNING cinder.quota [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1543810954 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1543810954, it is now deprecated. Please use the default quota class for default quota. Apr 25 15:49:22 devstack cinder-volume[81828]: WARNING cinder.quota [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1543810954 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1543810954, it is now deprecated. Please use the default quota class for default quota. Apr 25 15:49:22 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c40f5d4c-360a-4c9f-a8ad-855c11f80dcc tempest-ServersNegativeTestJSON-2079024930 None] Lock "cinder-quobyte-030858e4-9009-4aa4-a154-481ad427953d" acquired by "delete_volume" :: waited 0.023s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:49:22 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc74b7f8-5279-4074-9513-69f7f89def09]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:49:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c40f5d4c-360a-4c9f-a8ad-855c11f80dcc tempest-ServersNegativeTestJSON-2079024930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-030858e4-9009-4aa4-a154-481ad427953d {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:22 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] Created reservations ['2fac016e-53bd-4fd5-8190-ef1d9752a88e', '3d9e88b3-7309-4f11-949a-aea16e830956', '3e07f015-210c-4a11-9a71-ac0beab249bf', '4ce65484-ca29-4ad6-bf96-20f6effe40fb'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:49:22 devstack sudo[85061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-030858e4-9009-4aa4-a154-481ad427953d Apr 25 15:49:22 devstack sudo[85061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:22 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] Created reservations ['83d8d18c-8f4f-419c-aa7c-f307bbba5fa8', 'f282ce55-9adf-44c4-a2e1-5c28681435de', '358429ef-ed5c-4f15-88c6-cdae04fa559b', '4d106558-7b24-4907-a36d-75649c1396a5'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:49:23 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-615d17e3-aca2-495f-92dc-254519ccdbec tempest-GroupSnapshotsTest-536830151 None] group_snapshot a25373a5-0e2a-42d5-a3ee-741c1721f285: deleted successfully Apr 25 15:49:23 devstack sudo[85061]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c40f5d4c-360a-4c9f-a8ad-855c11f80dcc tempest-ServersNegativeTestJSON-2079024930 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-030858e4-9009-4aa4-a154-481ad427953d" returned: 0 in 0.761s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c40f5d4c-360a-4c9f-a8ad-855c11f80dcc tempest-ServersNegativeTestJSON-2079024930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-030858e4-9009-4aa4-a154-481ad427953d {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:23 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-81738477-411c-4b8d-ab10-3c1e6508030d tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "cinder-quobyte-22f1d530-9758-4b28-a6d5-76a809e801b1" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:49:23 devstack sudo[85066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-030858e4-9009-4aa4-a154-481ad427953d Apr 25 15:49:23 devstack sudo[85066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:23 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-81738477-411c-4b8d-ab10-3c1e6508030d tempest-GroupSnapshotsTest-536830151 None] Lock "cinder-quobyte-22f1d530-9758-4b28-a6d5-76a809e801b1" acquired by "delete_volume" :: waited 0.026s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:49:23 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d49d9e5-986d-4f41-8102-bf7b825d6d6d]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:49:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-81738477-411c-4b8d-ab10-3c1e6508030d tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:23 devstack sudo[85068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1 Apr 25 15:49:23 devstack sudo[85068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:24 devstack sudo[85066]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c40f5d4c-360a-4c9f-a8ad-855c11f80dcc tempest-ServersNegativeTestJSON-2079024930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-030858e4-9009-4aa4-a154-481ad427953d" returned: 0 in 0.591s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:24 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c40f5d4c-360a-4c9f-a8ad-855c11f80dcc tempest-ServersNegativeTestJSON-2079024930 None] Lock "cinder-quobyte-030858e4-9009-4aa4-a154-481ad427953d" released by "delete_volume" :: held 1.399s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:49:24 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-c40f5d4c-360a-4c9f-a8ad-855c11f80dcc tempest-ServersNegativeTestJSON-2079024930 None] Created reservations ['38f5b324-d32d-4bfd-9f0b-175f62db4535', 'c637c88a-d139-450c-820c-c80d5cb83398', 'd686c4ce-c0bf-47c5-b4d0-ed28bba4f0e7', '155497b3-6acd-44db-87d4-953528484039'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:49:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c40f5d4c-360a-4c9f-a8ad-855c11f80dcc tempest-ServersNegativeTestJSON-2079024930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:49:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c40f5d4c-360a-4c9f-a8ad-855c11f80dcc tempest-ServersNegativeTestJSON-2079024930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:49:24 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c40f5d4c-360a-4c9f-a8ad-855c11f80dcc tempest-ServersNegativeTestJSON-2079024930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:49:24 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c40f5d4c-360a-4c9f-a8ad-855c11f80dcc tempest-ServersNegativeTestJSON-2079024930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:49:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c40f5d4c-360a-4c9f-a8ad-855c11f80dcc tempest-ServersNegativeTestJSON-2079024930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:49:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c40f5d4c-360a-4c9f-a8ad-855c11f80dcc tempest-ServersNegativeTestJSON-2079024930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:24 devstack sudo[85068]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:24 devstack sudo[85074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:49:24 devstack sudo[85074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-81738477-411c-4b8d-ab10-3c1e6508030d tempest-GroupSnapshotsTest-536830151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1" returned: 0 in 0.767s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-81738477-411c-4b8d-ab10-3c1e6508030d tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:24 devstack sudo[85076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1 Apr 25 15:49:24 devstack sudo[85076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:25 devstack sudo[85074]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c40f5d4c-360a-4c9f-a8ad-855c11f80dcc tempest-ServersNegativeTestJSON-2079024930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.643s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:25 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-c40f5d4c-360a-4c9f-a8ad-855c11f80dcc tempest-ServersNegativeTestJSON-2079024930 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:49:25 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-c40f5d4c-360a-4c9f-a8ad-855c11f80dcc tempest-ServersNegativeTestJSON-2079024930 None] Deleted volume successfully. Apr 25 15:49:25 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c40f5d4c-360a-4c9f-a8ad-855c11f80dcc tempest-ServersNegativeTestJSON-2079024930 None] Lock "cinder-030858e4-9009-4aa4-a154-481ad427953d-delete_volume" released by "delete_volume" :: held 2.346s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:49:25 devstack sudo[85076]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-81738477-411c-4b8d-ab10-3c1e6508030d tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-22f1d530-9758-4b28-a6d5-76a809e801b1" returned: 0 in 0.648s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:25 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-81738477-411c-4b8d-ab10-3c1e6508030d tempest-GroupSnapshotsTest-536830151 None] Lock "cinder-quobyte-22f1d530-9758-4b28-a6d5-76a809e801b1" released by "delete_volume" :: held 1.481s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:49:25 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-81738477-411c-4b8d-ab10-3c1e6508030d tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "cinder-quobyte-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:49:25 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-81738477-411c-4b8d-ab10-3c1e6508030d tempest-GroupSnapshotsTest-536830151 None] Lock "cinder-quobyte-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5" acquired by "delete_volume" :: waited 0.023s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:49:25 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21db799-5be5-45e7-847a-deefffce487e]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:49:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-81738477-411c-4b8d-ab10-3c1e6508030d tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:25 devstack sudo[85081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5 Apr 25 15:49:25 devstack sudo[85081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:26 devstack sudo[85081]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-81738477-411c-4b8d-ab10-3c1e6508030d tempest-GroupSnapshotsTest-536830151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5" returned: 0 in 0.814s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-81738477-411c-4b8d-ab10-3c1e6508030d tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:26 devstack sudo[85086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5 Apr 25 15:49:26 devstack sudo[85086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:26 devstack sudo[85086]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-81738477-411c-4b8d-ab10-3c1e6508030d tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5" returned: 0 in 0.866s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:26 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-81738477-411c-4b8d-ab10-3c1e6508030d tempest-GroupSnapshotsTest-536830151 None] Lock "cinder-quobyte-6c5a5f27-a739-4149-aa24-0b9ebe09c6c5" released by "delete_volume" :: held 1.800s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:49:27 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-81738477-411c-4b8d-ab10-3c1e6508030d tempest-GroupSnapshotsTest-536830151 None] Created reservations ['97d79479-a711-493a-a48b-3a5921154d04'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:49:27 devstack cinder-volume[81828]: WARNING cinder.quota [None req-81738477-411c-4b8d-ab10-3c1e6508030d tempest-GroupSnapshotsTest-536830151 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1543810954 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1543810954, it is now deprecated. Please use the default quota class for default quota. Apr 25 15:49:27 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-81738477-411c-4b8d-ab10-3c1e6508030d tempest-GroupSnapshotsTest-536830151 None] Created reservations ['ac4bff3e-58a8-4032-8cde-1bc9596c8f5c', '37747f31-86e9-46d0-8cdf-859d8dc6cfd4', 'ee44380d-3e91-4db6-97ae-73af82314187', 'bcb426a0-a220-4642-b004-18d1042d9b28'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:49:27 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-81738477-411c-4b8d-ab10-3c1e6508030d tempest-GroupSnapshotsTest-536830151 None] Created reservations ['5e88fa43-dcee-4c34-9d18-b944302a95a8', 'bf94769f-8153-4c95-8f98-cee915608d82', '5398a45b-52e1-458b-b4a6-2d01f9608c55', 'cb04874e-244e-4883-907f-61c2a9d38cea'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:49:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-81738477-411c-4b8d-ab10-3c1e6508030d tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:49:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-81738477-411c-4b8d-ab10-3c1e6508030d tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:49:27 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-81738477-411c-4b8d-ab10-3c1e6508030d tempest-GroupSnapshotsTest-536830151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:49:27 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-81738477-411c-4b8d-ab10-3c1e6508030d tempest-GroupSnapshotsTest-536830151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:49:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-81738477-411c-4b8d-ab10-3c1e6508030d tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:49:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-81738477-411c-4b8d-ab10-3c1e6508030d tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:27 devstack sudo[85133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:49:27 devstack sudo[85133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:27 devstack sudo[85133]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-81738477-411c-4b8d-ab10-3c1e6508030d tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.500s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:27 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-81738477-411c-4b8d-ab10-3c1e6508030d tempest-GroupSnapshotsTest-536830151 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:49:27 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-81738477-411c-4b8d-ab10-3c1e6508030d tempest-GroupSnapshotsTest-536830151 None] Delete group completed successfully. Apr 25 15:49:28 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-6d7f36c2-55cc-4fd4-b956-6d61bd8bc318 tempest-GroupSnapshotsTest-536830151 None] Group tempest-GroupSnapshotsTest-Group-398619794: creating Apr 25 15:49:28 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-6d7f36c2-55cc-4fd4-b956-6d61bd8bc318 tempest-GroupSnapshotsTest-536830151 None] Group tempest-GroupSnapshotsTest-Group-398619794: created successfully Apr 25 15:49:28 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-6d7f36c2-55cc-4fd4-b956-6d61bd8bc318 tempest-GroupSnapshotsTest-536830151 None] Create group completed successfully. Apr 25 15:49:30 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:49:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] Flow 'volume_create_manager' (f2d28025-7402-472d-9db9-012c61077d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:49:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74968b6d-2b7a-421d-bc78-56e65a0a0c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74968b6d-2b7a-421d-bc78-56e65a0a0c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1526871873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0b6f6460-e96c-4103-b864-c9b973918741,host='devstack@QuobyteHD#QuobyteHD',id=06e1756f-531d-4252-b78c-9a1fd5f80e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fce156ffabb4b57aef047b587bf194d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:49:31Z,use_quota=True,user_id='aaefbbda6ecb422bb0daaaad82e2752a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d11ed89-4bf1-4950-8619-fb091ec05dac),volume_type_id=0d11ed89-4bf1-4950-8619-fb091ec05dac)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e4b7c1-a9c2-4229-b858-1ad84c7e765e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e4b7c1-a9c2-4229-b858-1ad84c7e765e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25498135-b2f2-4dce-b813-e81e4d44d885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25498135-b2f2-4dce-b813-e81e4d44d885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06e1756f-531d-4252-b78c-9a1fd5f80e02', 'volume_name': 'volume-06e1756f-531d-4252-b78c-9a1fd5f80e02', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e427b0f2-1928-4a20-b155-455a395c8e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e427b0f2-1928-4a20-b155-455a395c8e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81c00d85-4414-47e6-9c13-8cedd1d3473c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:30 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] Volume 06e1756f-531d-4252-b78c-9a1fd5f80e02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06e1756f-531d-4252-b78c-9a1fd5f80e02', 'volume_size': 1} Apr 25 15:49:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:49:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:49:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0b6f6460-e96c-4103-b864-c9b973918741,created_at=2026-04-25T13:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1526871873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0b6f6460-e96c-4103-b864-c9b973918741,host='devstack@QuobyteHD#QuobyteHD',id=06e1756f-531d-4252-b78c-9a1fd5f80e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fce156ffabb4b57aef047b587bf194d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:49:31Z,use_quota=True,user_id='aaefbbda6ecb422bb0daaaad82e2752a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d11ed89-4bf1-4950-8619-fb091ec05dac),volume_type_id=0d11ed89-4bf1-4950-8619-fb091ec05dac)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:49:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] Creating volume 06e1756f-531d-4252-b78c-9a1fd5f80e02 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:49:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:49:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:49:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:49:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:49:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:49:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:49:30 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:49:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:30 devstack sudo[85145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02 1073741824 Apr 25 15:49:30 devstack sudo[85145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:31 devstack sudo[85145]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02 1073741824" returned: 0 in 0.726s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:31 devstack sudo[85151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02 Apr 25 15:49:31 devstack sudo[85151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:32 devstack sudo[85151]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02" returned: 0 in 0.643s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:32 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:49:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:49:32 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81c00d85-4414-47e6-9c13-8cedd1d3473c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06e1756f-531d-4252-b78c-9a1fd5f80e02', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:32 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f9afb1-9e5e-42d9-a74a-4d633f5ab937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:32 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] Volume volume-06e1756f-531d-4252-b78c-9a1fd5f80e02 (06e1756f-531d-4252-b78c-9a1fd5f80e02): created successfully Apr 25 15:49:32 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f9afb1-9e5e-42d9-a74a-4d633f5ab937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:32 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] Flow 'volume_create_manager' (f2d28025-7402-472d-9db9-012c61077d18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:49:32 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-92e385af-91d4-4d16-88a0-2af5ebdc412b tempest-GroupSnapshotsTest-536830151 None] Created volume successfully. Apr 25 15:49:33 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-0a0eb1e7-fa09-4857-a487-9c9bee361937 tempest-GroupSnapshotsTest-536830151 None] GroupSnapshot 4098aa3b-94ff-4acc-ba06-be47cc234f12: creating. Apr 25 15:49:33 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0a0eb1e7-fa09-4857-a487-9c9bee361937 tempest-GroupSnapshotsTest-536830151 None] Group snapshot 4098aa3b-94ff-4acc-ba06-be47cc234f12: creating. {{(pid=81828) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 25 15:49:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0a0eb1e7-fa09-4857-a487-9c9bee361937 tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:49:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0a0eb1e7-fa09-4857-a487-9c9bee361937 tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:49:33 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-0a0eb1e7-fa09-4857-a487-9c9bee361937 tempest-GroupSnapshotsTest-536830151 None] Creating offline snapshot 6cd21a26-fd18-4d48-8790-e86aa2691870 of volume 06e1756f-531d-4252-b78c-9a1fd5f80e02 {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 15:49:33 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa69d9f0-f9fd-4da4-ae43-adb44834e7bd]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:49:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0a0eb1e7-fa09-4857-a487-9c9bee361937 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:33 devstack sudo[85189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02 Apr 25 15:49:33 devstack sudo[85189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:34 devstack sudo[85189]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0a0eb1e7-fa09-4857-a487-9c9bee361937 tempest-GroupSnapshotsTest-536830151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02" returned: 0 in 1.270s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0a0eb1e7-fa09-4857-a487-9c9bee361937 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02.6cd21a26-fd18-4d48-8790-e86aa2691870 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:34 devstack sudo[85217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02.6cd21a26-fd18-4d48-8790-e86aa2691870 1G Apr 25 15:49:34 devstack sudo[85217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:35 devstack sudo[85217]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0a0eb1e7-fa09-4857-a487-9c9bee361937 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02.6cd21a26-fd18-4d48-8790-e86aa2691870 1G" returned: 0 in 1.425s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0a0eb1e7-fa09-4857-a487-9c9bee361937 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06e1756f-531d-4252-b78c-9a1fd5f80e02 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02.6cd21a26-fd18-4d48-8790-e86aa2691870 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:36 devstack sudo[85225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06e1756f-531d-4252-b78c-9a1fd5f80e02 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02.6cd21a26-fd18-4d48-8790-e86aa2691870 Apr 25 15:49:36 devstack sudo[85225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:36 devstack sudo[85225]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0a0eb1e7-fa09-4857-a487-9c9bee361937 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06e1756f-531d-4252-b78c-9a1fd5f80e02 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02.6cd21a26-fd18-4d48-8790-e86aa2691870" returned: 0 in 0.913s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:36 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-0a0eb1e7-fa09-4857-a487-9c9bee361937 tempest-GroupSnapshotsTest-536830151 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02.6cd21a26-fd18-4d48-8790-e86aa2691870 is being set with open permissions: ugo+rw: NotImplementedError Apr 25 15:49:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0a0eb1e7-fa09-4857-a487-9c9bee361937 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02.6cd21a26-fd18-4d48-8790-e86aa2691870 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:36 devstack sudo[85231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02.6cd21a26-fd18-4d48-8790-e86aa2691870 Apr 25 15:49:36 devstack sudo[85231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:37 devstack sudo[85231]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0a0eb1e7-fa09-4857-a487-9c9bee361937 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02.6cd21a26-fd18-4d48-8790-e86aa2691870" returned: 0 in 0.742s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0a0eb1e7-fa09-4857-a487-9c9bee361937 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:37 devstack sudo[85234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02.info Apr 25 15:49:37 devstack sudo[85234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:38 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:49:38 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Flow 'volume_create_manager' (4bfa8649-7a3b-412f-979a-ce434a4e7d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:49:38 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dcde8d2-48d1-4047-8d28-32e388d6ab81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:38 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dcde8d2-48d1-4047-8d28-32e388d6ab81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1062056292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e536a9f-a611-48a2-adf4-e4e75ac866fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9abe1440025841a88f70f9767f9a1216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:49:38Z,use_quota=True,user_id='558c39d1327c42f6974078716ee791d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:38 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adac2a18-1d99-4474-9567-eafaef61e1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:38 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adac2a18-1d99-4474-9567-eafaef61e1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:38 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a8dfcf-e79c-45d5-9675-3548af0f534a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:38 devstack cinder-volume[81828]: DEBUG cinder.image.glance [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Creating Keystone auth plugin from conf {{(pid=81828) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 25 15:49:38 devstack sudo[85234]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0a0eb1e7-fa09-4857-a487-9c9bee361937 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02.info" returned: 0 in 0.975s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:38 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-0a0eb1e7-fa09-4857-a487-9c9bee361937 tempest-GroupSnapshotsTest-536830151 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02.info is being set with open permissions: ugo+rw: NotImplementedError Apr 25 15:49:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0a0eb1e7-fa09-4857-a487-9c9bee361937 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:38 devstack sudo[85238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02.info Apr 25 15:49:38 devstack sudo[85238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:39 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a8dfcf-e79c-45d5-9675-3548af0f534a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7e536a9f-a611-48a2-adf4-e4e75ac866fd', 'volume_name': 'volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd', 'volume_size': 1, 'image_id': '4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99560f74c63f4b9285294e59133188d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'created_at': datetime.datetime(2026, 4, 25, 13, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 13, 42, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:39 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5506877a-b1e0-4271-9b4c-19bfaf0310a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:39 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5506877a-b1e0-4271-9b4c-19bfaf0310a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:39 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c4f377-a876-4adb-bdc9-c7e822a28b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:39 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Volume 7e536a9f-a611-48a2-adf4-e4e75ac866fd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd', 'volume_size': 1, 'image_id': '4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99560f74c63f4b9285294e59133188d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'created_at': datetime.datetime(2026, 4, 25, 13, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 13, 42, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 25 15:49:39 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Trying to clone 7e536a9f-a611-48a2-adf4-e4e75ac866fd from image 4a29fc86-7ce4-447e-98ea-c141a6c39b3d at location (None, [{'url': 'file:///opt/stack/data/glance/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'metadata': {}}]). {{(pid=81828) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 25 15:49:39 devstack sudo[85238]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0a0eb1e7-fa09-4857-a487-9c9bee361937 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02.info" returned: 0 in 0.733s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0a0eb1e7-fa09-4857-a487-9c9bee361937 tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.187s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:49:39 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-0a0eb1e7-fa09-4857-a487-9c9bee361937 tempest-GroupSnapshotsTest-536830151 None] group_snapshot 4098aa3b-94ff-4acc-ba06-be47cc234f12: created successfully Apr 25 15:49:39 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_og0w1lwmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81828) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 25 15:49:39 devstack cinder-volume[81828]: INFO cinder.image.image_utils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Image download 20.69 MB at 20.69 MB/s Apr 25 15:49:39 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1c9197-41df-46dd-bd1c-cfdce531cc79]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:49:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_og0w1lwmdevstack@QuobyteHD {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:39 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-5279ed32-47a2-4a12-b078-80bba80d9845 tempest-GroupSnapshotsTest-536830151 None] group_snapshot 4098aa3b-94ff-4acc-ba06-be47cc234f12: deleting Apr 25 15:49:39 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-5279ed32-47a2-4a12-b078-80bba80d9845 tempest-GroupSnapshotsTest-536830151 None] group_snapshot 4098aa3b-94ff-4acc-ba06-be47cc234f12: deleting {{(pid=81828) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 25 15:49:40 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5279ed32-47a2-4a12-b078-80bba80d9845 tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "cinder-quobyte-06e1756f-531d-4252-b78c-9a1fd5f80e02" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:49:40 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5279ed32-47a2-4a12-b078-80bba80d9845 tempest-GroupSnapshotsTest-536830151 None] Lock "cinder-quobyte-06e1756f-531d-4252-b78c-9a1fd5f80e02" acquired by "delete_snapshot" :: waited 0.050s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:49:40 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5279ed32-47a2-4a12-b078-80bba80d9845 tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "cinder-quobyte-6cd21a26-fd18-4d48-8790-e86aa2691870" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:49:40 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5279ed32-47a2-4a12-b078-80bba80d9845 tempest-GroupSnapshotsTest-536830151 None] Lock "cinder-quobyte-6cd21a26-fd18-4d48-8790-e86aa2691870" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:49:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-5279ed32-47a2-4a12-b078-80bba80d9845 tempest-GroupSnapshotsTest-536830151 None] Deleting offline snapshot 6cd21a26-fd18-4d48-8790-e86aa2691870 of volume 06e1756f-531d-4252-b78c-9a1fd5f80e02 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 15:49:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-5279ed32-47a2-4a12-b078-80bba80d9845 tempest-GroupSnapshotsTest-536830151 None] snapshot_file for this snap is: volume-06e1756f-531d-4252-b78c-9a1fd5f80e02.6cd21a26-fd18-4d48-8790-e86aa2691870 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 15:49:40 devstack sudo[85265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_og0w1lwmdevstack@QuobyteHD Apr 25 15:49:40 devstack sudo[85265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:40 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[b859ec99-eaea-4956-8c45-5a6e78790b95]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:49:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5279ed32-47a2-4a12-b078-80bba80d9845 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02.6cd21a26-fd18-4d48-8790-e86aa2691870 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:40 devstack sudo[85267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02.6cd21a26-fd18-4d48-8790-e86aa2691870 Apr 25 15:49:40 devstack sudo[85267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:40 devstack sudo[85265]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_og0w1lwmdevstack@QuobyteHD" returned: 0 in 0.748s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:40 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Temporary image 4a29fc86-7ce4-447e-98ea-c141a6c39b3d is fetched for user 558c39d1327c42f6974078716ee791d8. {{(pid=81828) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 25 15:49:40 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd9fec1-57ea-497d-aaf3-1a5fa6001399]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:49:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_og0w1lwmdevstack@QuobyteHD {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:40 devstack sudo[85272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_og0w1lwmdevstack@QuobyteHD Apr 25 15:49:40 devstack sudo[85272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:41 devstack sudo[85267]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5279ed32-47a2-4a12-b078-80bba80d9845 tempest-GroupSnapshotsTest-536830151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02.6cd21a26-fd18-4d48-8790-e86aa2691870" returned: 0 in 0.872s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:41 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-5279ed32-47a2-4a12-b078-80bba80d9845 tempest-GroupSnapshotsTest-536830151 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06e1756f-531d-4252-b78c-9a1fd5f80e02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:49:41 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a85afa-51fd-4350-b9f5-6500c9747cd6]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:49:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5279ed32-47a2-4a12-b078-80bba80d9845 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:41 devstack sudo[85272]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_og0w1lwmdevstack@QuobyteHD" returned: 0 in 0.623s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:49:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:49:41 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:49:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1062056292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e536a9f-a611-48a2-adf4-e4e75ac866fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9abe1440025841a88f70f9767f9a1216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:49:38Z,use_quota=True,user_id='558c39d1327c42f6974078716ee791d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:49:41 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Creating volume 7e536a9f-a611-48a2-adf4-e4e75ac866fd {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:49:41 devstack sudo[85277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02 Apr 25 15:49:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:49:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:49:41 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:49:41 devstack sudo[85277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:41 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:49:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:49:41 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:49:41 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:49:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:41 devstack sudo[85283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd 1073741824 Apr 25 15:49:41 devstack sudo[85283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:42 devstack sudo[85277]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5279ed32-47a2-4a12-b078-80bba80d9845 tempest-GroupSnapshotsTest-536830151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02" returned: 0 in 1.002s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5279ed32-47a2-4a12-b078-80bba80d9845 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02.6cd21a26-fd18-4d48-8790-e86aa2691870 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:42 devstack sudo[85298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02.6cd21a26-fd18-4d48-8790-e86aa2691870 Apr 25 15:49:42 devstack sudo[85298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:42 devstack sudo[85283]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd 1073741824" returned: 0 in 1.036s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:42 devstack sudo[85312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd Apr 25 15:49:42 devstack sudo[85312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:43 devstack sudo[85298]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5279ed32-47a2-4a12-b078-80bba80d9845 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02.6cd21a26-fd18-4d48-8790-e86aa2691870" returned: 0 in 1.035s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5279ed32-47a2-4a12-b078-80bba80d9845 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02.6cd21a26-fd18-4d48-8790-e86aa2691870 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:43 devstack sudo[85323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02.6cd21a26-fd18-4d48-8790-e86aa2691870 Apr 25 15:49:43 devstack sudo[85323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:43 devstack sudo[85312]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd" returned: 0 in 0.891s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:43 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] <== create_volume: return (2007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:49:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.011s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:49:43 devstack cinder-volume[81828]: DEBUG cinder.volume.volume_utils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Attempting download of 4a29fc86-7ce4-447e-98ea-c141a6c39b3d ((None, [{'url': 'file:///opt/stack/data/glance/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'metadata': {}}])) to volume 7e536a9f-a611-48a2-adf4-e4e75ac866fd. {{(pid=81828) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 25 15:49:43 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dbbffd-646a-45d6-aa40-247794c4d0dd]: (4, 'raw') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:49:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_a_chvgvh {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:43 devstack sudo[85345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_a_chvgvh Apr 25 15:49:43 devstack sudo[85345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:43 devstack sudo[85323]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5279ed32-47a2-4a12-b078-80bba80d9845 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02.6cd21a26-fd18-4d48-8790-e86aa2691870" returned: 0 in 0.737s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5279ed32-47a2-4a12-b078-80bba80d9845 tempest-GroupSnapshotsTest-536830151 None] Lock "cinder-quobyte-6cd21a26-fd18-4d48-8790-e86aa2691870" released by "_delete_snapshot" :: held 3.856s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:49:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5279ed32-47a2-4a12-b078-80bba80d9845 tempest-GroupSnapshotsTest-536830151 None] Lock "cinder-quobyte-06e1756f-531d-4252-b78c-9a1fd5f80e02" released by "delete_snapshot" :: held 3.900s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:49:44 devstack cinder-volume[81828]: WARNING cinder.quota [None req-5279ed32-47a2-4a12-b078-80bba80d9845 tempest-GroupSnapshotsTest-536830151 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-322172778 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-322172778, it is now deprecated. Please use the default quota class for default quota. Apr 25 15:49:44 devstack cinder-volume[81828]: WARNING cinder.quota [None req-5279ed32-47a2-4a12-b078-80bba80d9845 tempest-GroupSnapshotsTest-536830151 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-322172778 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-322172778, it is now deprecated. Please use the default quota class for default quota. Apr 25 15:49:44 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-5279ed32-47a2-4a12-b078-80bba80d9845 tempest-GroupSnapshotsTest-536830151 None] Created reservations ['c061a254-83af-44f8-a207-d12097283c11', 'ca81b13a-44b8-4dec-afc1-4bbac4675521', '7205bedf-69a0-4b45-90fa-e6339809a7f1', '69d267c8-cd1c-498d-8a66-44856f6655eb'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:49:44 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:49:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] Flow 'volume_create_manager' (0b761083-3450-492c-84e4-5f4821b8f6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:49:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89495db2-55f9-4ef4-844d-7458889648ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89495db2-55f9-4ef4-844d-7458889648ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1887147849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ffb63d-b49b-4c4f-a44e-d59474c50beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ffbb64c9fb14e2c9404a6a5329bc16c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:49:44Z,use_quota=True,user_id='5e21715114a1441587abeedb7a2fe7ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2b1594-4f37-4b3f-892e-fd2c62e1f630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:44 devstack sudo[85345]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec2b1594-4f37-4b3f-892e-fd2c62e1f630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad67239e-7b89-482e-883e-7c006a1d2851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad67239e-7b89-482e-883e-7c006a1d2851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78ffb63d-b49b-4c4f-a44e-d59474c50beb', 'volume_name': 'volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fde6c00-2e51-42e4-b908-da67d1103d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fde6c00-2e51-42e4-b908-da67d1103d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b808ca5-0b92-417e-8bb3-2a515aaea453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:44 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] Volume 78ffb63d-b49b-4c4f-a44e-d59474c50beb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb', 'volume_size': 1} Apr 25 15:49:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:49:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:49:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1887147849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ffb63d-b49b-4c4f-a44e-d59474c50beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ffbb64c9fb14e2c9404a6a5329bc16c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:49:44Z,use_quota=True,user_id='5e21715114a1441587abeedb7a2fe7ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:49:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] Creating volume 78ffb63d-b49b-4c4f-a44e-d59474c50beb {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:49:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:49:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:49:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:49:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:49:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:49:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:49:44 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:49:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_a_chvgvh" returned: 0 in 0.863s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_a_chvgvh {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:44 devstack sudo[85350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb 1073741824 Apr 25 15:49:44 devstack sudo[85350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:44 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-5279ed32-47a2-4a12-b078-80bba80d9845 tempest-GroupSnapshotsTest-536830151 None] group_snapshot 4098aa3b-94ff-4acc-ba06-be47cc234f12: deleted successfully Apr 25 15:49:44 devstack sudo[85351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_a_chvgvh Apr 25 15:49:44 devstack sudo[85351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:45 devstack sudo[85351]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_a_chvgvh" returned: 1 in 0.725s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_a_chvgvh' failed. Not Retrying. {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 25 15:49:45 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[a065e2ba-8d76-4bb7-802c-ca68c23e9569]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:49:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_og0w1lwmdevstack@QuobyteHD {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:45 devstack sudo[85359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_og0w1lwmdevstack@QuobyteHD Apr 25 15:49:45 devstack sudo[85359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:45 devstack sudo[85350]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb 1073741824" returned: 0 in 0.977s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:45 devstack sudo[85361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb Apr 25 15:49:45 devstack sudo[85361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:45 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-bb26524d-251b-40be-8676-c47b84a9b562 tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "cinder-quobyte-06e1756f-531d-4252-b78c-9a1fd5f80e02" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:49:45 devstack sudo[85359]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:45 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-bb26524d-251b-40be-8676-c47b84a9b562 tempest-GroupSnapshotsTest-536830151 None] Lock "cinder-quobyte-06e1756f-531d-4252-b78c-9a1fd5f80e02" acquired by "delete_volume" :: waited 0.040s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:49:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_og0w1lwmdevstack@QuobyteHD" returned: 0 in 0.873s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:45 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] 4a29fc86-7ce4-447e-98ea-c141a6c39b3d was qcow2, converting to raw {{(pid=81828) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 25 15:49:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_og0w1lwmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:46 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[2928a309-0f6d-4fe4-bf09-54ee7c83b59b]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:49:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bb26524d-251b-40be-8676-c47b84a9b562 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:46 devstack sudo[85367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_og0w1lwmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd Apr 25 15:49:46 devstack sudo[85367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:46 devstack sudo[85368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02 Apr 25 15:49:46 devstack sudo[85368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:46 devstack sudo[85361]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb" returned: 0 in 0.855s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:46 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:49:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:49:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b808ca5-0b92-417e-8bb3-2a515aaea453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (476d350c-226f-4a79-bf96-e0febf96c69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:46 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] Volume volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb (78ffb63d-b49b-4c4f-a44e-d59474c50beb): created successfully Apr 25 15:49:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (476d350c-226f-4a79-bf96-e0febf96c69d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] Flow 'volume_create_manager' (0b761083-3450-492c-84e4-5f4821b8f6f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:49:46 devstack cinder-volume[81828]: INFO cinder.volume.manager [req-f1d1784f-b993-4db5-ae51-24c92aeb2858 req-063ea849-8225-48a2-85fb-047d03a4046a tempest-VolumesSnapshotsTestJSON-1367555499 None] Created volume successfully. Apr 25 15:49:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-850359b0-ef36-4f5a-9630-e9278a1c5263 req-9a011865-32d5-48b6-af07-fc6ab4dc5e55 tempest-VolumesSnapshotsTestJSON-1367555499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:49:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-850359b0-ef36-4f5a-9630-e9278a1c5263 req-9a011865-32d5-48b6-af07-fc6ab4dc5e55 tempest-VolumesSnapshotsTestJSON-1367555499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:49:46 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [req-850359b0-ef36-4f5a-9630-e9278a1c5263 req-9a011865-32d5-48b6-af07-fc6ab4dc5e55 tempest-VolumesSnapshotsTestJSON-1367555499 None] Creating offline snapshot f83830e1-2453-4878-88b3-6c66a1e1cf83 of volume 78ffb63d-b49b-4c4f-a44e-d59474c50beb {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 15:49:46 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4947ecb-04ec-4979-90b8-8444fb491067]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:49:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-850359b0-ef36-4f5a-9630-e9278a1c5263 req-9a011865-32d5-48b6-af07-fc6ab4dc5e55 tempest-VolumesSnapshotsTestJSON-1367555499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:46 devstack sudo[85368]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bb26524d-251b-40be-8676-c47b84a9b562 tempest-GroupSnapshotsTest-536830151 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02" returned: 0 in 0.923s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bb26524d-251b-40be-8676-c47b84a9b562 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:46 devstack sudo[85402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb Apr 25 15:49:46 devstack sudo[85402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:46 devstack sudo[85407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02 Apr 25 15:49:47 devstack sudo[85407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:47 devstack sudo[85402]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-850359b0-ef36-4f5a-9630-e9278a1c5263 req-9a011865-32d5-48b6-af07-fc6ab4dc5e55 tempest-VolumesSnapshotsTestJSON-1367555499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb" returned: 0 in 0.665s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-850359b0-ef36-4f5a-9630-e9278a1c5263 req-9a011865-32d5-48b6-af07-fc6ab4dc5e55 tempest-VolumesSnapshotsTestJSON-1367555499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb.f83830e1-2453-4878-88b3-6c66a1e1cf83 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:47 devstack sudo[85413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb.f83830e1-2453-4878-88b3-6c66a1e1cf83 1G Apr 25 15:49:47 devstack sudo[85413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:47 devstack sudo[85407]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bb26524d-251b-40be-8676-c47b84a9b562 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-06e1756f-531d-4252-b78c-9a1fd5f80e02" returned: 0 in 0.701s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:47 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-bb26524d-251b-40be-8676-c47b84a9b562 tempest-GroupSnapshotsTest-536830151 None] Lock "cinder-quobyte-06e1756f-531d-4252-b78c-9a1fd5f80e02" released by "delete_volume" :: held 1.737s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:49:47 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-bb26524d-251b-40be-8676-c47b84a9b562 tempest-GroupSnapshotsTest-536830151 None] Created reservations ['fdcc780d-96ee-4525-81c0-bc061bbb8b2e'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:49:47 devstack cinder-volume[81828]: WARNING cinder.quota [None req-bb26524d-251b-40be-8676-c47b84a9b562 tempest-GroupSnapshotsTest-536830151 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-322172778 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-322172778, it is now deprecated. Please use the default quota class for default quota. Apr 25 15:49:47 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-bb26524d-251b-40be-8676-c47b84a9b562 tempest-GroupSnapshotsTest-536830151 None] Created reservations ['24e958b5-e166-46e8-b8de-37dbce35bbea', '98e0940b-853d-4b4c-b2c2-f772ac9b8b3e', 'dd8b0cba-fa05-4d61-af1e-0714cc578648', '26be57b9-ab53-4d33-946c-6ddb96908e18'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:49:47 devstack sudo[85367]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_og0w1lwmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd" returned: 0 in 1.863s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:47 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_og0w1lwmdevstack@QuobyteHD, size 112.00 MB, duration 1.86 sec, destination /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd {{(pid=81828) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 15:49:47 devstack cinder-volume[81828]: INFO cinder.image.image_utils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Converted 112.00 MB image at 60.08 MB/s Apr 25 15:49:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:47 devstack sudo[85416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd 1G Apr 25 15:49:47 devstack sudo[85416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bb26524d-251b-40be-8676-c47b84a9b562 tempest-GroupSnapshotsTest-536830151 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:49:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bb26524d-251b-40be-8676-c47b84a9b562 tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:49:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-bb26524d-251b-40be-8676-c47b84a9b562 tempest-GroupSnapshotsTest-536830151 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:49:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-bb26524d-251b-40be-8676-c47b84a9b562 tempest-GroupSnapshotsTest-536830151 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:49:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bb26524d-251b-40be-8676-c47b84a9b562 tempest-GroupSnapshotsTest-536830151 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:49:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bb26524d-251b-40be-8676-c47b84a9b562 tempest-GroupSnapshotsTest-536830151 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:47 devstack sudo[85420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:49:47 devstack sudo[85420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:48 devstack sudo[85413]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-850359b0-ef36-4f5a-9630-e9278a1c5263 req-9a011865-32d5-48b6-af07-fc6ab4dc5e55 tempest-VolumesSnapshotsTestJSON-1367555499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb.f83830e1-2453-4878-88b3-6c66a1e1cf83 1G" returned: 0 in 0.685s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-850359b0-ef36-4f5a-9630-e9278a1c5263 req-9a011865-32d5-48b6-af07-fc6ab4dc5e55 tempest-VolumesSnapshotsTestJSON-1367555499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb.f83830e1-2453-4878-88b3-6c66a1e1cf83 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:48 devstack sudo[85423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb.f83830e1-2453-4878-88b3-6c66a1e1cf83 Apr 25 15:49:48 devstack sudo[85423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:48 devstack sudo[85416]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd 1G" returned: 0 in 0.680s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:48 devstack sudo[85420]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bb26524d-251b-40be-8676-c47b84a9b562 tempest-GroupSnapshotsTest-536830151 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.659s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:48 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-bb26524d-251b-40be-8676-c47b84a9b562 tempest-GroupSnapshotsTest-536830151 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:49:48 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-bb26524d-251b-40be-8676-c47b84a9b562 tempest-GroupSnapshotsTest-536830151 None] Delete group completed successfully. Apr 25 15:49:48 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19d7715-8a39-43d2-a839-38acc38913e9]: (4, 'raw') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:49:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:48 devstack sudo[85429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd Apr 25 15:49:48 devstack sudo[85429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:48 devstack sudo[85423]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-850359b0-ef36-4f5a-9630-e9278a1c5263 req-9a011865-32d5-48b6-af07-fc6ab4dc5e55 tempest-VolumesSnapshotsTestJSON-1367555499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb.f83830e1-2453-4878-88b3-6c66a1e1cf83" returned: 0 in 0.713s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:48 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [req-850359b0-ef36-4f5a-9630-e9278a1c5263 req-9a011865-32d5-48b6-af07-fc6ab4dc5e55 tempest-VolumesSnapshotsTestJSON-1367555499 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb.f83830e1-2453-4878-88b3-6c66a1e1cf83 is being set with open permissions: ugo+rw Apr 25 15:49:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-850359b0-ef36-4f5a-9630-e9278a1c5263 req-9a011865-32d5-48b6-af07-fc6ab4dc5e55 tempest-VolumesSnapshotsTestJSON-1367555499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb.f83830e1-2453-4878-88b3-6c66a1e1cf83 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:48 devstack sudo[85434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb.f83830e1-2453-4878-88b3-6c66a1e1cf83 Apr 25 15:49:48 devstack sudo[85434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:49 devstack sudo[85429]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd" returned: 0 in 0.792s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:49 devstack sudo[85442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd Apr 25 15:49:49 devstack sudo[85442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:49 devstack sudo[85434]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-850359b0-ef36-4f5a-9630-e9278a1c5263 req-9a011865-32d5-48b6-af07-fc6ab4dc5e55 tempest-VolumesSnapshotsTestJSON-1367555499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb.f83830e1-2453-4878-88b3-6c66a1e1cf83" returned: 0 in 0.687s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-850359b0-ef36-4f5a-9630-e9278a1c5263 req-9a011865-32d5-48b6-af07-fc6ab4dc5e55 tempest-VolumesSnapshotsTestJSON-1367555499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:49 devstack sudo[85445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb.info Apr 25 15:49:49 devstack sudo[85445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:50 devstack sudo[85442]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd" returned: 1 in 0.680s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd' failed. Not Retrying. {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 25 15:49:50 devstack cinder-volume[81828]: DEBUG cinder.volume.volume_utils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Downloaded image 4a29fc86-7ce4-447e-98ea-c141a6c39b3d ((None, [{'url': 'file:///opt/stack/data/glance/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'metadata': {}}])) to volume 7e536a9f-a611-48a2-adf4-e4e75ac866fd successfully. {{(pid=81828) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 25 15:49:50 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Temporary image 4a29fc86-7ce4-447e-98ea-c141a6c39b3d for user 558c39d1327c42f6974078716ee791d8 is deleted. {{(pid=81828) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 25 15:49:50 devstack cinder-volume[81828]: DEBUG cinder.volume.volume_utils [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Marking volume 7e536a9f-a611-48a2-adf4-e4e75ac866fd as bootable. {{(pid=81828) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 25 15:49:50 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Copying metadata from image 4a29fc86-7ce4-447e-98ea-c141a6c39b3d to 7e536a9f-a611-48a2-adf4-e4e75ac866fd. {{(pid=81828) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 25 15:49:50 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Creating volume glance metadata for volume 7e536a9f-a611-48a2-adf4-e4e75ac866fd backed by image 4a29fc86-7ce4-447e-98ea-c141a6c39b3d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81828) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 25 15:49:50 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c4f377-a876-4adb-bdc9-c7e822a28b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd', 'volume_size': 1, 'image_id': '4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99560f74c63f4b9285294e59133188d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'created_at': datetime.datetime(2026, 4, 25, 13, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 13, 42, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:50 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a0c9208-2433-494e-87f5-94efc6abec5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:50 devstack sudo[85445]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:50 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Volume volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd (7e536a9f-a611-48a2-adf4-e4e75ac866fd): created successfully Apr 25 15:49:50 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a0c9208-2433-494e-87f5-94efc6abec5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:50 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Flow 'volume_create_manager' (4bfa8649-7a3b-412f-979a-ce434a4e7d24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:49:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-850359b0-ef36-4f5a-9630-e9278a1c5263 req-9a011865-32d5-48b6-af07-fc6ab4dc5e55 tempest-VolumesSnapshotsTestJSON-1367555499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb.info" returned: 0 in 0.636s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:50 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [req-850359b0-ef36-4f5a-9630-e9278a1c5263 req-9a011865-32d5-48b6-af07-fc6ab4dc5e55 tempest-VolumesSnapshotsTestJSON-1367555499 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb.info is being set with open permissions: ugo+rw Apr 25 15:49:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-850359b0-ef36-4f5a-9630-e9278a1c5263 req-9a011865-32d5-48b6-af07-fc6ab4dc5e55 tempest-VolumesSnapshotsTestJSON-1367555499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:50 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-3ffe5842-efd8-4b43-afdc-699a82ef4c48 tempest-VolumesImageMetadata-1602963173 None] Created volume successfully. Apr 25 15:49:50 devstack sudo[85453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb.info Apr 25 15:49:50 devstack sudo[85453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:50 devstack sudo[85453]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-850359b0-ef36-4f5a-9630-e9278a1c5263 req-9a011865-32d5-48b6-af07-fc6ab4dc5e55 tempest-VolumesSnapshotsTestJSON-1367555499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb.info" returned: 0 in 0.642s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-850359b0-ef36-4f5a-9630-e9278a1c5263 req-9a011865-32d5-48b6-af07-fc6ab4dc5e55 tempest-VolumesSnapshotsTestJSON-1367555499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.151s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:49:50 devstack cinder-volume[81828]: INFO cinder.volume.manager [req-850359b0-ef36-4f5a-9630-e9278a1c5263 req-9a011865-32d5-48b6-af07-fc6ab4dc5e55 tempest-VolumesSnapshotsTestJSON-1367555499 None] Create snapshot completed successfully Apr 25 15:49:50 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-25c271d7-515a-4c2d-ad59-ce5c21db9d38 tempest-VolumesImageMetadata-1602963173 None] Acquiring lock "cinder-7e536a9f-a611-48a2-adf4-e4e75ac866fd-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:49:50 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-25c271d7-515a-4c2d-ad59-ce5c21db9d38 tempest-VolumesImageMetadata-1602963173 None] Lock "cinder-7e536a9f-a611-48a2-adf4-e4e75ac866fd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:49:51 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-25c271d7-515a-4c2d-ad59-ce5c21db9d38 tempest-VolumesImageMetadata-1602963173 None] Acquiring lock "cinder-quobyte-7e536a9f-a611-48a2-adf4-e4e75ac866fd" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:49:51 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-25c271d7-515a-4c2d-ad59-ce5c21db9d38 tempest-VolumesImageMetadata-1602963173 None] Lock "cinder-quobyte-7e536a9f-a611-48a2-adf4-e4e75ac866fd" acquired by "delete_volume" :: waited 0.038s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:49:51 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ff7cb6-2f3f-419a-a49b-d936cc097222]: (4, 'raw') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:49:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-25c271d7-515a-4c2d-ad59-ce5c21db9d38 tempest-VolumesImageMetadata-1602963173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:51 devstack sudo[85463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd Apr 25 15:49:51 devstack sudo[85463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:51 devstack cinder-volume[81828]: DEBUG cinder.coordination [req-23f459b1-36f7-4217-ac1a-d715d1bd1cdf req-a400f9f8-d653-488c-8d17-c0a97cc62ba2 tempest-VolumesSnapshotsTestJSON-1367555499 None] Acquiring lock "cinder-f83830e1-2453-4878-88b3-6c66a1e1cf83-delete_snapshot" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:49:51 devstack cinder-volume[81828]: DEBUG cinder.coordination [req-23f459b1-36f7-4217-ac1a-d715d1bd1cdf req-a400f9f8-d653-488c-8d17-c0a97cc62ba2 tempest-VolumesSnapshotsTestJSON-1367555499 None] Lock "cinder-f83830e1-2453-4878-88b3-6c66a1e1cf83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:49:51 devstack cinder-volume[81828]: DEBUG cinder.coordination [req-23f459b1-36f7-4217-ac1a-d715d1bd1cdf req-a400f9f8-d653-488c-8d17-c0a97cc62ba2 tempest-VolumesSnapshotsTestJSON-1367555499 None] Acquiring lock "cinder-quobyte-78ffb63d-b49b-4c4f-a44e-d59474c50beb" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:49:51 devstack cinder-volume[81828]: DEBUG cinder.coordination [req-23f459b1-36f7-4217-ac1a-d715d1bd1cdf req-a400f9f8-d653-488c-8d17-c0a97cc62ba2 tempest-VolumesSnapshotsTestJSON-1367555499 None] Lock "cinder-quobyte-78ffb63d-b49b-4c4f-a44e-d59474c50beb" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:49:51 devstack cinder-volume[81828]: DEBUG cinder.coordination [req-23f459b1-36f7-4217-ac1a-d715d1bd1cdf req-a400f9f8-d653-488c-8d17-c0a97cc62ba2 tempest-VolumesSnapshotsTestJSON-1367555499 None] Acquiring lock "cinder-quobyte-f83830e1-2453-4878-88b3-6c66a1e1cf83" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:49:51 devstack cinder-volume[81828]: DEBUG cinder.coordination [req-23f459b1-36f7-4217-ac1a-d715d1bd1cdf req-a400f9f8-d653-488c-8d17-c0a97cc62ba2 tempest-VolumesSnapshotsTestJSON-1367555499 None] Lock "cinder-quobyte-f83830e1-2453-4878-88b3-6c66a1e1cf83" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:49:51 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [req-23f459b1-36f7-4217-ac1a-d715d1bd1cdf req-a400f9f8-d653-488c-8d17-c0a97cc62ba2 tempest-VolumesSnapshotsTestJSON-1367555499 None] Deleting offline snapshot f83830e1-2453-4878-88b3-6c66a1e1cf83 of volume 78ffb63d-b49b-4c4f-a44e-d59474c50beb {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 15:49:51 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [req-23f459b1-36f7-4217-ac1a-d715d1bd1cdf req-a400f9f8-d653-488c-8d17-c0a97cc62ba2 tempest-VolumesSnapshotsTestJSON-1367555499 None] snapshot_file for this snap is: volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb.f83830e1-2453-4878-88b3-6c66a1e1cf83 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 15:49:51 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd00d4be-9a8c-4072-a5ad-b1241e1560d6]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:49:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-23f459b1-36f7-4217-ac1a-d715d1bd1cdf req-a400f9f8-d653-488c-8d17-c0a97cc62ba2 tempest-VolumesSnapshotsTestJSON-1367555499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb.f83830e1-2453-4878-88b3-6c66a1e1cf83 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:51 devstack sudo[85465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb.f83830e1-2453-4878-88b3-6c66a1e1cf83 Apr 25 15:49:51 devstack sudo[85465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:51 devstack sudo[85463]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-25c271d7-515a-4c2d-ad59-ce5c21db9d38 tempest-VolumesImageMetadata-1602963173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd" returned: 0 in 0.727s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-25c271d7-515a-4c2d-ad59-ce5c21db9d38 tempest-VolumesImageMetadata-1602963173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:51 devstack sudo[85469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd Apr 25 15:49:51 devstack sudo[85469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:52 devstack sudo[85465]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-23f459b1-36f7-4217-ac1a-d715d1bd1cdf req-a400f9f8-d653-488c-8d17-c0a97cc62ba2 tempest-VolumesSnapshotsTestJSON-1367555499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb.f83830e1-2453-4878-88b3-6c66a1e1cf83" returned: 0 in 0.648s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:52 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [req-23f459b1-36f7-4217-ac1a-d715d1bd1cdf req-a400f9f8-d653-488c-8d17-c0a97cc62ba2 tempest-VolumesSnapshotsTestJSON-1367555499 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:49:52 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca908e4-8776-4c7b-9295-b9fd4fae0ecc]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:49:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-23f459b1-36f7-4217-ac1a-d715d1bd1cdf req-a400f9f8-d653-488c-8d17-c0a97cc62ba2 tempest-VolumesSnapshotsTestJSON-1367555499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:52 devstack sudo[85474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb Apr 25 15:49:52 devstack sudo[85474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:52 devstack sudo[85469]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-25c271d7-515a-4c2d-ad59-ce5c21db9d38 tempest-VolumesImageMetadata-1602963173 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd" returned: 1 in 0.627s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-25c271d7-515a-4c2d-ad59-ce5c21db9d38 tempest-VolumesImageMetadata-1602963173 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd' failed. Not Retrying. {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 25 15:49:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-25c271d7-515a-4c2d-ad59-ce5c21db9d38 tempest-VolumesImageMetadata-1602963173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:52 devstack sudo[85479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd Apr 25 15:49:52 devstack sudo[85479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:52 devstack sudo[85474]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-23f459b1-36f7-4217-ac1a-d715d1bd1cdf req-a400f9f8-d653-488c-8d17-c0a97cc62ba2 tempest-VolumesSnapshotsTestJSON-1367555499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb" returned: 0 in 0.611s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-23f459b1-36f7-4217-ac1a-d715d1bd1cdf req-a400f9f8-d653-488c-8d17-c0a97cc62ba2 tempest-VolumesSnapshotsTestJSON-1367555499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb.f83830e1-2453-4878-88b3-6c66a1e1cf83 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:52 devstack sudo[85484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb.f83830e1-2453-4878-88b3-6c66a1e1cf83 Apr 25 15:49:52 devstack sudo[85484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:53 devstack sudo[85479]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-25c271d7-515a-4c2d-ad59-ce5c21db9d38 tempest-VolumesImageMetadata-1602963173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7e536a9f-a611-48a2-adf4-e4e75ac866fd" returned: 0 in 0.587s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:53 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-25c271d7-515a-4c2d-ad59-ce5c21db9d38 tempest-VolumesImageMetadata-1602963173 None] Lock "cinder-quobyte-7e536a9f-a611-48a2-adf4-e4e75ac866fd" released by "delete_volume" :: held 2.027s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:49:53 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-25c271d7-515a-4c2d-ad59-ce5c21db9d38 tempest-VolumesImageMetadata-1602963173 None] Created reservations ['aee9892f-b223-4207-8c2e-4ae8438fd871', 'e64d6a65-1c7d-4436-a4c2-b167b61f1618', '99ef4fe8-501d-4b93-8565-24b7cd5c5291', 'ab7bbf9f-6c4a-4183-a584-1cadb28fa119'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:49:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-25c271d7-515a-4c2d-ad59-ce5c21db9d38 tempest-VolumesImageMetadata-1602963173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:49:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-25c271d7-515a-4c2d-ad59-ce5c21db9d38 tempest-VolumesImageMetadata-1602963173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:49:53 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-25c271d7-515a-4c2d-ad59-ce5c21db9d38 tempest-VolumesImageMetadata-1602963173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:49:53 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-25c271d7-515a-4c2d-ad59-ce5c21db9d38 tempest-VolumesImageMetadata-1602963173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:49:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-25c271d7-515a-4c2d-ad59-ce5c21db9d38 tempest-VolumesImageMetadata-1602963173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:49:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-25c271d7-515a-4c2d-ad59-ce5c21db9d38 tempest-VolumesImageMetadata-1602963173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:53 devstack sudo[85487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:49:53 devstack sudo[85487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:53 devstack sudo[85484]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-23f459b1-36f7-4217-ac1a-d715d1bd1cdf req-a400f9f8-d653-488c-8d17-c0a97cc62ba2 tempest-VolumesSnapshotsTestJSON-1367555499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb.f83830e1-2453-4878-88b3-6c66a1e1cf83" returned: 0 in 0.736s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-23f459b1-36f7-4217-ac1a-d715d1bd1cdf req-a400f9f8-d653-488c-8d17-c0a97cc62ba2 tempest-VolumesSnapshotsTestJSON-1367555499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb.f83830e1-2453-4878-88b3-6c66a1e1cf83 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:53 devstack sudo[85492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb.f83830e1-2453-4878-88b3-6c66a1e1cf83 Apr 25 15:49:53 devstack sudo[85492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:53 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-a5789063-116b-4a61-a3d7-f8bad97952b0 tempest-GroupSnapshotsV319Test-1816949060 None] Group tempest-GroupSnapshotsV319Test-Group-525284574: creating Apr 25 15:49:53 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-a5789063-116b-4a61-a3d7-f8bad97952b0 tempest-GroupSnapshotsV319Test-1816949060 None] Group tempest-GroupSnapshotsV319Test-Group-525284574: created successfully Apr 25 15:49:53 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-a5789063-116b-4a61-a3d7-f8bad97952b0 tempest-GroupSnapshotsV319Test-1816949060 None] Create group completed successfully. Apr 25 15:49:53 devstack sudo[85487]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-25c271d7-515a-4c2d-ad59-ce5c21db9d38 tempest-VolumesImageMetadata-1602963173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.576s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:53 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-25c271d7-515a-4c2d-ad59-ce5c21db9d38 tempest-VolumesImageMetadata-1602963173 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:49:53 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-25c271d7-515a-4c2d-ad59-ce5c21db9d38 tempest-VolumesImageMetadata-1602963173 None] Deleted volume successfully. Apr 25 15:49:53 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-25c271d7-515a-4c2d-ad59-ce5c21db9d38 tempest-VolumesImageMetadata-1602963173 None] Lock "cinder-7e536a9f-a611-48a2-adf4-e4e75ac866fd-delete_volume" released by "delete_volume" :: held 2.915s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:49:54 devstack sudo[85492]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-23f459b1-36f7-4217-ac1a-d715d1bd1cdf req-a400f9f8-d653-488c-8d17-c0a97cc62ba2 tempest-VolumesSnapshotsTestJSON-1367555499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb.f83830e1-2453-4878-88b3-6c66a1e1cf83" returned: 0 in 0.513s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:54 devstack cinder-volume[81828]: DEBUG cinder.coordination [req-23f459b1-36f7-4217-ac1a-d715d1bd1cdf req-a400f9f8-d653-488c-8d17-c0a97cc62ba2 tempest-VolumesSnapshotsTestJSON-1367555499 None] Lock "cinder-quobyte-f83830e1-2453-4878-88b3-6c66a1e1cf83" released by "_delete_snapshot" :: held 2.650s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:49:54 devstack cinder-volume[81828]: DEBUG cinder.coordination [req-23f459b1-36f7-4217-ac1a-d715d1bd1cdf req-a400f9f8-d653-488c-8d17-c0a97cc62ba2 tempest-VolumesSnapshotsTestJSON-1367555499 None] Lock "cinder-quobyte-78ffb63d-b49b-4c4f-a44e-d59474c50beb" released by "delete_snapshot" :: held 2.688s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:49:54 devstack cinder-volume[81828]: DEBUG cinder.quota [req-23f459b1-36f7-4217-ac1a-d715d1bd1cdf req-a400f9f8-d653-488c-8d17-c0a97cc62ba2 tempest-VolumesSnapshotsTestJSON-1367555499 None] Created reservations ['862ca0bb-7dbf-4691-ba1c-a25b93525f6f', '654adeb8-3453-4758-9d48-28fe1988de0e', 'ac468090-ef2e-4123-a38f-94dc3b7fbcc5', '27d3c99b-9f96-49ed-a327-98538dd14472'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:49:54 devstack cinder-volume[81828]: INFO cinder.volume.manager [req-23f459b1-36f7-4217-ac1a-d715d1bd1cdf req-a400f9f8-d653-488c-8d17-c0a97cc62ba2 tempest-VolumesSnapshotsTestJSON-1367555499 None] Delete snapshot completed successfully. Apr 25 15:49:54 devstack cinder-volume[81828]: DEBUG cinder.coordination [req-23f459b1-36f7-4217-ac1a-d715d1bd1cdf req-a400f9f8-d653-488c-8d17-c0a97cc62ba2 tempest-VolumesSnapshotsTestJSON-1367555499 None] Lock "cinder-f83830e1-2453-4878-88b3-6c66a1e1cf83-delete_snapshot" released by "delete_snapshot" :: held 2.913s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:49:54 devstack cinder-volume[81828]: DEBUG cinder.coordination [req-460b4f65-64b1-4dd7-8149-8ceb3bee81e7 req-8ac1db94-2baa-4bf1-a37b-8cc8e3dbfb8d tempest-VolumesSnapshotsTestJSON-1367555499 None] Acquiring lock "cinder-78ffb63d-b49b-4c4f-a44e-d59474c50beb-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:49:54 devstack cinder-volume[81828]: DEBUG cinder.coordination [req-460b4f65-64b1-4dd7-8149-8ceb3bee81e7 req-8ac1db94-2baa-4bf1-a37b-8cc8e3dbfb8d tempest-VolumesSnapshotsTestJSON-1367555499 None] Lock "cinder-78ffb63d-b49b-4c4f-a44e-d59474c50beb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:49:54 devstack cinder-volume[81828]: DEBUG cinder.coordination [req-460b4f65-64b1-4dd7-8149-8ceb3bee81e7 req-8ac1db94-2baa-4bf1-a37b-8cc8e3dbfb8d tempest-VolumesSnapshotsTestJSON-1367555499 None] Acquiring lock "cinder-quobyte-78ffb63d-b49b-4c4f-a44e-d59474c50beb" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:49:54 devstack cinder-volume[81828]: DEBUG cinder.coordination [req-460b4f65-64b1-4dd7-8149-8ceb3bee81e7 req-8ac1db94-2baa-4bf1-a37b-8cc8e3dbfb8d tempest-VolumesSnapshotsTestJSON-1367555499 None] Lock "cinder-quobyte-78ffb63d-b49b-4c4f-a44e-d59474c50beb" acquired by "delete_volume" :: waited 0.020s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:49:55 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c14349-6f25-48d4-ad21-0eac1d2d0c7e]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:49:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-460b4f65-64b1-4dd7-8149-8ceb3bee81e7 req-8ac1db94-2baa-4bf1-a37b-8cc8e3dbfb8d tempest-VolumesSnapshotsTestJSON-1367555499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:55 devstack sudo[85496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb Apr 25 15:49:55 devstack sudo[85496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:55 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:49:55 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] Flow 'volume_create_manager' (b447a232-c747-45ea-bdc7-100a86c48741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:49:55 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ca0d0cd-4a7e-473c-9f3a-ce257575a2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:55 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ca0d0cd-4a7e-473c-9f3a-ce257575a2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1681158384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=746954a4-cfa6-491f-af69-01cb8aa74e94,host='devstack@QuobyteHD#QuobyteHD',id=43e5c84d-3604-425c-a791-4b1da0960665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc1c754f2580420295ac12d45294a0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:49:55Z,use_quota=True,user_id='ba05899560454042b3743318539b60cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41a30a06-d7d2-4160-96a6-86cd2051cfd8),volume_type_id=41a30a06-d7d2-4160-96a6-86cd2051cfd8)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:55 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cf0e883-8e81-487f-848f-140972a21967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:55 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cf0e883-8e81-487f-848f-140972a21967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:55 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a94e4c-9dfa-468c-b5aa-4ee5635973e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:55 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38a94e4c-9dfa-468c-b5aa-4ee5635973e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43e5c84d-3604-425c-a791-4b1da0960665', 'volume_name': 'volume-43e5c84d-3604-425c-a791-4b1da0960665', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:55 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1193c209-6b18-4d30-baca-82ac5d1ab605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:55 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1193c209-6b18-4d30-baca-82ac5d1ab605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:55 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (991d5352-0799-4e90-be12-e9ba9cbbff19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:55 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] Volume 43e5c84d-3604-425c-a791-4b1da0960665: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43e5c84d-3604-425c-a791-4b1da0960665', 'volume_size': 1} Apr 25 15:49:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:49:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:49:55 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=746954a4-cfa6-491f-af69-01cb8aa74e94,created_at=2026-04-25T13:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1681158384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=746954a4-cfa6-491f-af69-01cb8aa74e94,host='devstack@QuobyteHD#QuobyteHD',id=43e5c84d-3604-425c-a791-4b1da0960665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc1c754f2580420295ac12d45294a0ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:49:55Z,use_quota=True,user_id='ba05899560454042b3743318539b60cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41a30a06-d7d2-4160-96a6-86cd2051cfd8),volume_type_id=41a30a06-d7d2-4160-96a6-86cd2051cfd8)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:49:55 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] Creating volume 43e5c84d-3604-425c-a791-4b1da0960665 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:49:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:49:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:49:55 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:49:55 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:49:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:49:55 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:49:55 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:49:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:55 devstack sudo[85498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665 1073741824 Apr 25 15:49:55 devstack sudo[85498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:56 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:49:56 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Flow 'volume_create_manager' (7e21c63c-c033-4e5f-a3a7-fbb5f2f6936e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:49:56 devstack sudo[85496]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:56 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356c633c-b305-4b1c-8fcc-9d041a5a3e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-460b4f65-64b1-4dd7-8149-8ceb3bee81e7 req-8ac1db94-2baa-4bf1-a37b-8cc8e3dbfb8d tempest-VolumesSnapshotsTestJSON-1367555499 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb" returned: 0 in 1.316s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-460b4f65-64b1-4dd7-8149-8ceb3bee81e7 req-8ac1db94-2baa-4bf1-a37b-8cc8e3dbfb8d tempest-VolumesSnapshotsTestJSON-1367555499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:56 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356c633c-b305-4b1c-8fcc-9d041a5a3e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:49:56Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=303cc37b-c821-43ea-bf35-e142bcc73758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eeb6c17f5ca4343b865fc5813dd09d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:49:56Z,use_quota=True,user_id='ca260fa0e18c49ec86bb079c4a7c0f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:56 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f88f28-f9e0-403e-8f1e-9f6c2e5353e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:56 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f88f28-f9e0-403e-8f1e-9f6c2e5353e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:56 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9431350-e8c0-4341-83de-fbd6e469e1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:56 devstack cinder-volume[81828]: DEBUG cinder.image.glance [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Creating Keystone auth plugin from conf {{(pid=81828) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 25 15:49:56 devstack sudo[85506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb Apr 25 15:49:56 devstack sudo[85506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:56 devstack sudo[85498]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665 1073741824" returned: 0 in 0.865s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:56 devstack sudo[85508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665 Apr 25 15:49:56 devstack sudo[85508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:56 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9431350-e8c0-4341-83de-fbd6e469e1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '303cc37b-c821-43ea-bf35-e142bcc73758', 'volume_name': 'volume-303cc37b-c821-43ea-bf35-e142bcc73758', 'volume_size': 1, 'image_id': '4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99560f74c63f4b9285294e59133188d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'created_at': datetime.datetime(2026, 4, 25, 13, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 13, 42, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:56 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59a79c86-1720-41cb-944f-71f04c2edad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:56 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59a79c86-1720-41cb-944f-71f04c2edad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:56 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35244f37-67ba-4f53-b84b-33ed2f8d8259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:56 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Volume 303cc37b-c821-43ea-bf35-e142bcc73758: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-303cc37b-c821-43ea-bf35-e142bcc73758', 'volume_size': 1, 'image_id': '4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99560f74c63f4b9285294e59133188d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'created_at': datetime.datetime(2026, 4, 25, 13, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 13, 42, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 25 15:49:56 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Trying to clone 303cc37b-c821-43ea-bf35-e142bcc73758 from image 4a29fc86-7ce4-447e-98ea-c141a6c39b3d at location (None, [{'url': 'file:///opt/stack/data/glance/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'metadata': {}}]). {{(pid=81828) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 25 15:49:57 devstack sudo[85506]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-460b4f65-64b1-4dd7-8149-8ceb3bee81e7 req-8ac1db94-2baa-4bf1-a37b-8cc8e3dbfb8d tempest-VolumesSnapshotsTestJSON-1367555499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-78ffb63d-b49b-4c4f-a44e-d59474c50beb" returned: 0 in 0.765s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:57 devstack cinder-volume[81828]: DEBUG cinder.coordination [req-460b4f65-64b1-4dd7-8149-8ceb3bee81e7 req-8ac1db94-2baa-4bf1-a37b-8cc8e3dbfb8d tempest-VolumesSnapshotsTestJSON-1367555499 None] Lock "cinder-quobyte-78ffb63d-b49b-4c4f-a44e-d59474c50beb" released by "delete_volume" :: held 2.201s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:49:57 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_3nzuvq60devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81828) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 25 15:49:57 devstack cinder-volume[81828]: INFO cinder.image.image_utils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Image download 20.69 MB at 20.69 MB/s Apr 25 15:49:57 devstack cinder-volume[81828]: DEBUG cinder.quota [req-460b4f65-64b1-4dd7-8149-8ceb3bee81e7 req-8ac1db94-2baa-4bf1-a37b-8cc8e3dbfb8d tempest-VolumesSnapshotsTestJSON-1367555499 None] Created reservations ['bcd74b39-bb2a-4cca-b599-a741c7899486', 'b85eb14e-0e6c-440c-bc89-286be2ca9987', '02f1a204-9752-4abd-b40d-858565c8bd09', '33fdda2a-3118-4ee1-9d2c-a55ace4a434d'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:49:57 devstack sudo[85508]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:57 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a91be3-d2f6-4d05-b01a-32cda986afcb]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:49:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_3nzuvq60devstack@QuobyteHD {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665" returned: 0 in 0.829s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:57 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:49:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:49:57 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (991d5352-0799-4e90-be12-e9ba9cbbff19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43e5c84d-3604-425c-a791-4b1da0960665', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:57 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4e27918-6df5-448d-a00b-b8052c919338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:57 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] Volume volume-43e5c84d-3604-425c-a791-4b1da0960665 (43e5c84d-3604-425c-a791-4b1da0960665): created successfully Apr 25 15:49:57 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4e27918-6df5-448d-a00b-b8052c919338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:57 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] Flow 'volume_create_manager' (b447a232-c747-45ea-bdc7-100a86c48741) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:49:57 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-cc6d92dc-d792-47fd-a233-82f6e627e284 tempest-GroupSnapshotsV319Test-1816949060 None] Created volume successfully. Apr 25 15:49:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-460b4f65-64b1-4dd7-8149-8ceb3bee81e7 req-8ac1db94-2baa-4bf1-a37b-8cc8e3dbfb8d tempest-VolumesSnapshotsTestJSON-1367555499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:49:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-460b4f65-64b1-4dd7-8149-8ceb3bee81e7 req-8ac1db94-2baa-4bf1-a37b-8cc8e3dbfb8d tempest-VolumesSnapshotsTestJSON-1367555499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:49:57 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [req-460b4f65-64b1-4dd7-8149-8ceb3bee81e7 req-8ac1db94-2baa-4bf1-a37b-8cc8e3dbfb8d tempest-VolumesSnapshotsTestJSON-1367555499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:49:57 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [req-460b4f65-64b1-4dd7-8149-8ceb3bee81e7 req-8ac1db94-2baa-4bf1-a37b-8cc8e3dbfb8d tempest-VolumesSnapshotsTestJSON-1367555499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:49:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-460b4f65-64b1-4dd7-8149-8ceb3bee81e7 req-8ac1db94-2baa-4bf1-a37b-8cc8e3dbfb8d tempest-VolumesSnapshotsTestJSON-1367555499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:49:57 devstack sudo[85515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_3nzuvq60devstack@QuobyteHD Apr 25 15:49:57 devstack sudo[85515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-460b4f65-64b1-4dd7-8149-8ceb3bee81e7 req-8ac1db94-2baa-4bf1-a37b-8cc8e3dbfb8d tempest-VolumesSnapshotsTestJSON-1367555499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:57 devstack sudo[85517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:49:57 devstack sudo[85517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:57 devstack sudo[85515]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_3nzuvq60devstack@QuobyteHD" returned: 0 in 0.649s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:57 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Temporary image 4a29fc86-7ce4-447e-98ea-c141a6c39b3d is fetched for user ca260fa0e18c49ec86bb079c4a7c0f8b. {{(pid=81828) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 25 15:49:58 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[1003b39f-19a6-4742-ae07-13ce1cda5fdf]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:49:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_3nzuvq60devstack@QuobyteHD {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:58 devstack sudo[85517]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-460b4f65-64b1-4dd7-8149-8ceb3bee81e7 req-8ac1db94-2baa-4bf1-a37b-8cc8e3dbfb8d tempest-VolumesSnapshotsTestJSON-1367555499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.631s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:58 devstack cinder-volume[81828]: DEBUG cinder.manager [req-460b4f65-64b1-4dd7-8149-8ceb3bee81e7 req-8ac1db94-2baa-4bf1-a37b-8cc8e3dbfb8d tempest-VolumesSnapshotsTestJSON-1367555499 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:49:58 devstack cinder-volume[81828]: INFO cinder.volume.manager [req-460b4f65-64b1-4dd7-8149-8ceb3bee81e7 req-8ac1db94-2baa-4bf1-a37b-8cc8e3dbfb8d tempest-VolumesSnapshotsTestJSON-1367555499 None] Deleted volume successfully. Apr 25 15:49:58 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-43fd61bd-ead5-4cfa-b1f5-1a911334b1e4 tempest-GroupSnapshotsV319Test-1816949060 None] GroupSnapshot 40e58723-c34a-4193-b6af-a714cecff7af: creating. Apr 25 15:49:58 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-43fd61bd-ead5-4cfa-b1f5-1a911334b1e4 tempest-GroupSnapshotsV319Test-1816949060 None] Group snapshot 40e58723-c34a-4193-b6af-a714cecff7af: creating. {{(pid=81828) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 25 15:49:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-43fd61bd-ead5-4cfa-b1f5-1a911334b1e4 tempest-GroupSnapshotsV319Test-1816949060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:49:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-43fd61bd-ead5-4cfa-b1f5-1a911334b1e4 tempest-GroupSnapshotsV319Test-1816949060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:49:58 devstack sudo[85523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_3nzuvq60devstack@QuobyteHD Apr 25 15:49:58 devstack sudo[85523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:58 devstack cinder-volume[81828]: DEBUG cinder.coordination [req-460b4f65-64b1-4dd7-8149-8ceb3bee81e7 req-8ac1db94-2baa-4bf1-a37b-8cc8e3dbfb8d tempest-VolumesSnapshotsTestJSON-1367555499 None] Lock "cinder-78ffb63d-b49b-4c4f-a44e-d59474c50beb-delete_volume" released by "delete_volume" :: held 3.357s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:49:58 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-43fd61bd-ead5-4cfa-b1f5-1a911334b1e4 tempest-GroupSnapshotsV319Test-1816949060 None] Creating offline snapshot 5ad756d7-a01e-4da4-be3f-4f6ddb715637 of volume 43e5c84d-3604-425c-a791-4b1da0960665 {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 15:49:58 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e256ad5-edbb-4032-80df-63f74e7930f4]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:49:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-43fd61bd-ead5-4cfa-b1f5-1a911334b1e4 tempest-GroupSnapshotsV319Test-1816949060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:58 devstack sudo[85525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665 Apr 25 15:49:58 devstack sudo[85525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:58 devstack sudo[85523]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_3nzuvq60devstack@QuobyteHD" returned: 0 in 0.756s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:49:58 devstack sudo[85525]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-43fd61bd-ead5-4cfa-b1f5-1a911334b1e4 tempest-GroupSnapshotsV319Test-1816949060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665" returned: 0 in 0.690s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-43fd61bd-ead5-4cfa-b1f5-1a911334b1e4 tempest-GroupSnapshotsV319Test-1816949060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665.5ad756d7-a01e-4da4-be3f-4f6ddb715637 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:58 devstack sudo[85533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665.5ad756d7-a01e-4da4-be3f-4f6ddb715637 1G Apr 25 15:49:59 devstack sudo[85533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:49:59 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:49:59 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] Flow 'volume_create_manager' (505cbe1e-376b-43e6-a747-62950290af52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:49:59 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf074e44-b1f3-4b72-b6ac-819e1fb20441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:59 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf074e44-b1f3-4b72-b6ac-819e1fb20441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-840376659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc0c029e-8e10-4748-af80-21737f656a02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a1ec161ba04f51b1721641181a7294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:49:59Z,use_quota=True,user_id='3385dcebe0c8441dbf2fc8bc205c9675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:59 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c103c6-0cd3-4c89-a934-dd50751a58b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:59 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37c103c6-0cd3-4c89-a934-dd50751a58b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:59 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c05e28ed-5f80-488c-921f-00de21e18912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:59 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c05e28ed-5f80-488c-921f-00de21e18912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc0c029e-8e10-4748-af80-21737f656a02', 'volume_name': 'volume-bc0c029e-8e10-4748-af80-21737f656a02', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:59 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b7dbd1-eb59-46f2-94e2-88c2ab3708f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:59 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b7dbd1-eb59-46f2-94e2-88c2ab3708f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:49:59 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d23bfa-cdb7-4372-8836-264b452ed645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:49:59 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] Volume bc0c029e-8e10-4748-af80-21737f656a02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc0c029e-8e10-4748-af80-21737f656a02', 'volume_size': 1} Apr 25 15:49:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:49:59 devstack sudo[85533]: pam_unix(sudo:session): session closed for user root Apr 25 15:49:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-43fd61bd-ead5-4cfa-b1f5-1a911334b1e4 tempest-GroupSnapshotsV319Test-1816949060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665.5ad756d7-a01e-4da4-be3f-4f6ddb715637 1G" returned: 0 in 0.937s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:49:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-43fd61bd-ead5-4cfa-b1f5-1a911334b1e4 tempest-GroupSnapshotsV319Test-1816949060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43e5c84d-3604-425c-a791-4b1da0960665 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665.5ad756d7-a01e-4da4-be3f-4f6ddb715637 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:49:59 devstack sudo[85538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43e5c84d-3604-425c-a791-4b1da0960665 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665.5ad756d7-a01e-4da4-be3f-4f6ddb715637 Apr 25 15:49:59 devstack sudo[85538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:00 devstack cinder-volume[81828]: DEBUG oslo_service.periodic_task [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81828) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 25 15:50:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:50:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:50:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:50:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:50:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:50:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:00 devstack sudo[85540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:50:00 devstack sudo[85540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:00 devstack sudo[85538]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-43fd61bd-ead5-4cfa-b1f5-1a911334b1e4 tempest-GroupSnapshotsV319Test-1816949060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43e5c84d-3604-425c-a791-4b1da0960665 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665.5ad756d7-a01e-4da4-be3f-4f6ddb715637" returned: 0 in 0.660s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:00 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-43fd61bd-ead5-4cfa-b1f5-1a911334b1e4 tempest-GroupSnapshotsV319Test-1816949060 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665.5ad756d7-a01e-4da4-be3f-4f6ddb715637 is being set with open permissions: ugo+rw: NotImplementedError Apr 25 15:50:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-43fd61bd-ead5-4cfa-b1f5-1a911334b1e4 tempest-GroupSnapshotsV319Test-1816949060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665.5ad756d7-a01e-4da4-be3f-4f6ddb715637 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:00 devstack sudo[85545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665.5ad756d7-a01e-4da4-be3f-4f6ddb715637 Apr 25 15:50:00 devstack sudo[85545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:00 devstack sudo[85540]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.611s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:00 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:50:01 devstack sudo[85545]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-43fd61bd-ead5-4cfa-b1f5-1a911334b1e4 tempest-GroupSnapshotsV319Test-1816949060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665.5ad756d7-a01e-4da4-be3f-4f6ddb715637" returned: 0 in 0.503s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-43fd61bd-ead5-4cfa-b1f5-1a911334b1e4 tempest-GroupSnapshotsV319Test-1816949060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:01 devstack sudo[85549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665.info Apr 25 15:50:01 devstack sudo[85549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:01 devstack sudo[85549]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-43fd61bd-ead5-4cfa-b1f5-1a911334b1e4 tempest-GroupSnapshotsV319Test-1816949060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665.info" returned: 0 in 0.516s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:01 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-43fd61bd-ead5-4cfa-b1f5-1a911334b1e4 tempest-GroupSnapshotsV319Test-1816949060 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665.info is being set with open permissions: ugo+rw: NotImplementedError Apr 25 15:50:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-43fd61bd-ead5-4cfa-b1f5-1a911334b1e4 tempest-GroupSnapshotsV319Test-1816949060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:01 devstack sudo[85553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665.info Apr 25 15:50:01 devstack sudo[85553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:02 devstack sudo[85553]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-43fd61bd-ead5-4cfa-b1f5-1a911334b1e4 tempest-GroupSnapshotsV319Test-1816949060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665.info" returned: 0 in 0.487s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-43fd61bd-ead5-4cfa-b1f5-1a911334b1e4 tempest-GroupSnapshotsV319Test-1816949060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.903s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:50:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.266s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:50:02 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:49:56Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=303cc37b-c821-43ea-bf35-e142bcc73758,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eeb6c17f5ca4343b865fc5813dd09d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:49:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:49:56Z,use_quota=True,user_id='ca260fa0e18c49ec86bb079c4a7c0f8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:50:02 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Creating volume 303cc37b-c821-43ea-bf35-e142bcc73758 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:50:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:50:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:50:02 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:50:02 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:50:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:50:02 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:50:02 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:50:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:02 devstack sudo[85556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758 1073741824 Apr 25 15:50:02 devstack sudo[85556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:02 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-43fd61bd-ead5-4cfa-b1f5-1a911334b1e4 tempest-GroupSnapshotsV319Test-1816949060 None] group_snapshot 40e58723-c34a-4193-b6af-a714cecff7af: created successfully Apr 25 15:50:02 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-23bdb0b6-9f16-4aaa-81af-0a9c490a3d34 tempest-GroupSnapshotsV319Test-1816949060 None] group_snapshot 40e58723-c34a-4193-b6af-a714cecff7af: deleting Apr 25 15:50:02 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-23bdb0b6-9f16-4aaa-81af-0a9c490a3d34 tempest-GroupSnapshotsV319Test-1816949060 None] group_snapshot 40e58723-c34a-4193-b6af-a714cecff7af: deleting {{(pid=81828) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 25 15:50:02 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-23bdb0b6-9f16-4aaa-81af-0a9c490a3d34 tempest-GroupSnapshotsV319Test-1816949060 None] Acquiring lock "cinder-quobyte-43e5c84d-3604-425c-a791-4b1da0960665" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:50:02 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-23bdb0b6-9f16-4aaa-81af-0a9c490a3d34 tempest-GroupSnapshotsV319Test-1816949060 None] Lock "cinder-quobyte-43e5c84d-3604-425c-a791-4b1da0960665" acquired by "delete_snapshot" :: waited 0.027s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:50:02 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-23bdb0b6-9f16-4aaa-81af-0a9c490a3d34 tempest-GroupSnapshotsV319Test-1816949060 None] Acquiring lock "cinder-quobyte-5ad756d7-a01e-4da4-be3f-4f6ddb715637" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:50:02 devstack sudo[85556]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:02 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-23bdb0b6-9f16-4aaa-81af-0a9c490a3d34 tempest-GroupSnapshotsV319Test-1816949060 None] Lock "cinder-quobyte-5ad756d7-a01e-4da4-be3f-4f6ddb715637" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:50:02 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-23bdb0b6-9f16-4aaa-81af-0a9c490a3d34 tempest-GroupSnapshotsV319Test-1816949060 None] Deleting offline snapshot 5ad756d7-a01e-4da4-be3f-4f6ddb715637 of volume 43e5c84d-3604-425c-a791-4b1da0960665 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 15:50:02 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-23bdb0b6-9f16-4aaa-81af-0a9c490a3d34 tempest-GroupSnapshotsV319Test-1816949060 None] snapshot_file for this snap is: volume-43e5c84d-3604-425c-a791-4b1da0960665.5ad756d7-a01e-4da4-be3f-4f6ddb715637 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 15:50:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758 1073741824" returned: 0 in 0.855s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:02 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc82b187-8980-4fb6-97ed-3317136d785a]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:50:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-23bdb0b6-9f16-4aaa-81af-0a9c490a3d34 tempest-GroupSnapshotsV319Test-1816949060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665.5ad756d7-a01e-4da4-be3f-4f6ddb715637 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:03 devstack sudo[85562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758 Apr 25 15:50:03 devstack sudo[85562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:03 devstack sudo[85561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665.5ad756d7-a01e-4da4-be3f-4f6ddb715637 Apr 25 15:50:03 devstack sudo[85561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:03 devstack sudo[85562]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:03 devstack sudo[85561]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758" returned: 0 in 0.615s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:03 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:50:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:50:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.138s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:50:03 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-840376659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc0c029e-8e10-4748-af80-21737f656a02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6a1ec161ba04f51b1721641181a7294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:49:59Z,use_quota=True,user_id='3385dcebe0c8441dbf2fc8bc205c9675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:50:03 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] Creating volume bc0c029e-8e10-4748-af80-21737f656a02 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:50:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:50:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:50:03 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:50:03 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:50:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:50:03 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:50:03 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:50:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bc0c029e-8e10-4748-af80-21737f656a02 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-23bdb0b6-9f16-4aaa-81af-0a9c490a3d34 tempest-GroupSnapshotsV319Test-1816949060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665.5ad756d7-a01e-4da4-be3f-4f6ddb715637" returned: 0 in 0.692s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:03 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-23bdb0b6-9f16-4aaa-81af-0a9c490a3d34 tempest-GroupSnapshotsV319Test-1816949060 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43e5c84d-3604-425c-a791-4b1da0960665(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:50:03 devstack sudo[85569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bc0c029e-8e10-4748-af80-21737f656a02 1073741824 Apr 25 15:50:03 devstack sudo[85569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:03 devstack cinder-volume[81828]: DEBUG cinder.volume.volume_utils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Attempting download of 4a29fc86-7ce4-447e-98ea-c141a6c39b3d ((None, [{'url': 'file:///opt/stack/data/glance/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'metadata': {}}])) to volume 303cc37b-c821-43ea-bf35-e142bcc73758. {{(pid=81828) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 25 15:50:03 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed16765-1f00-4c5a-9b87-7c1a20cbd2f9]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:50:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-23bdb0b6-9f16-4aaa-81af-0a9c490a3d34 tempest-GroupSnapshotsV319Test-1816949060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:03 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef19ca53-fd42-4be4-ab63-9ea7930ffda7]: (4, 'raw') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:50:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_bfzwahpa {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:03 devstack sudo[85571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665 Apr 25 15:50:03 devstack sudo[85571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:03 devstack sudo[85572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_bfzwahpa Apr 25 15:50:03 devstack sudo[85572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:04 devstack sudo[85572]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_bfzwahpa" returned: 0 in 0.616s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_bfzwahpa {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:04 devstack sudo[85569]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bc0c029e-8e10-4748-af80-21737f656a02 1073741824" returned: 0 in 0.772s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:04 devstack sudo[85571]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-23bdb0b6-9f16-4aaa-81af-0a9c490a3d34 tempest-GroupSnapshotsV319Test-1816949060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665" returned: 0 in 0.729s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-23bdb0b6-9f16-4aaa-81af-0a9c490a3d34 tempest-GroupSnapshotsV319Test-1816949060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665.5ad756d7-a01e-4da4-be3f-4f6ddb715637 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bc0c029e-8e10-4748-af80-21737f656a02 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:04 devstack sudo[85584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665.5ad756d7-a01e-4da4-be3f-4f6ddb715637 Apr 25 15:50:04 devstack sudo[85584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:04 devstack sudo[85583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_bfzwahpa Apr 25 15:50:04 devstack sudo[85583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:04 devstack sudo[85585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bc0c029e-8e10-4748-af80-21737f656a02 Apr 25 15:50:04 devstack sudo[85585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:05 devstack sudo[85583]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_bfzwahpa" returned: 1 in 0.677s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_bfzwahpa' failed. Not Retrying. {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 25 15:50:05 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b57a212-bcb4-44ea-a4cd-1fa8e35ab7d8]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:50:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_3nzuvq60devstack@QuobyteHD {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:05 devstack sudo[85585]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bc0c029e-8e10-4748-af80-21737f656a02" returned: 0 in 0.593s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:05 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] <== create_volume: return (1430ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:50:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:50:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02d23bfa-cdb7-4372-8836-264b452ed645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc0c029e-8e10-4748-af80-21737f656a02', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dae169c-6491-4a03-a8c8-a79d74dfdd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:05 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] Volume volume-bc0c029e-8e10-4748-af80-21737f656a02 (bc0c029e-8e10-4748-af80-21737f656a02): created successfully Apr 25 15:50:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dae169c-6491-4a03-a8c8-a79d74dfdd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:05 devstack sudo[85584]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] Flow 'volume_create_manager' (505cbe1e-376b-43e6-a747-62950290af52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:50:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-23bdb0b6-9f16-4aaa-81af-0a9c490a3d34 tempest-GroupSnapshotsV319Test-1816949060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665.5ad756d7-a01e-4da4-be3f-4f6ddb715637" returned: 0 in 0.691s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-23bdb0b6-9f16-4aaa-81af-0a9c490a3d34 tempest-GroupSnapshotsV319Test-1816949060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665.5ad756d7-a01e-4da4-be3f-4f6ddb715637 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:05 devstack sudo[85595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_3nzuvq60devstack@QuobyteHD Apr 25 15:50:05 devstack sudo[85595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:05 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-cedb6b5d-4a28-4f61-8651-d2acbd03b88f tempest-AbsoluteLimitsTests-1598418906 None] Created volume successfully. Apr 25 15:50:05 devstack sudo[85596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665.5ad756d7-a01e-4da4-be3f-4f6ddb715637 Apr 25 15:50:05 devstack sudo[85596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:05 devstack sudo[85595]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_3nzuvq60devstack@QuobyteHD" returned: 0 in 0.657s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:05 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] 4a29fc86-7ce4-447e-98ea-c141a6c39b3d was qcow2, converting to raw {{(pid=81828) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 25 15:50:05 devstack sudo[85596]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_3nzuvq60devstack@QuobyteHD /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-23bdb0b6-9f16-4aaa-81af-0a9c490a3d34 tempest-GroupSnapshotsV319Test-1816949060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665.5ad756d7-a01e-4da4-be3f-4f6ddb715637" returned: 0 in 0.616s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:05 devstack sudo[85603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_3nzuvq60devstack@QuobyteHD /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758 Apr 25 15:50:05 devstack sudo[85603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:05 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-23bdb0b6-9f16-4aaa-81af-0a9c490a3d34 tempest-GroupSnapshotsV319Test-1816949060 None] Lock "cinder-quobyte-5ad756d7-a01e-4da4-be3f-4f6ddb715637" released by "_delete_snapshot" :: held 2.905s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:50:05 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-7361a822-405b-4095-a6f5-d441121e6ff1 tempest-GroupsV320Test-809139567 None] Group tempest-GroupsV320Test-Group-1068382980: creating Apr 25 15:50:05 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-23bdb0b6-9f16-4aaa-81af-0a9c490a3d34 tempest-GroupSnapshotsV319Test-1816949060 None] Lock "cinder-quobyte-43e5c84d-3604-425c-a791-4b1da0960665" released by "delete_snapshot" :: held 2.952s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:50:05 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-7361a822-405b-4095-a6f5-d441121e6ff1 tempest-GroupsV320Test-809139567 None] Group tempest-GroupsV320Test-Group-1068382980: created successfully Apr 25 15:50:05 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-7361a822-405b-4095-a6f5-d441121e6ff1 tempest-GroupsV320Test-809139567 None] Create group completed successfully. Apr 25 15:50:05 devstack cinder-volume[81828]: WARNING cinder.quota [None req-23bdb0b6-9f16-4aaa-81af-0a9c490a3d34 tempest-GroupSnapshotsV319Test-1816949060 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-588393113 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-588393113, it is now deprecated. Please use the default quota class for default quota. Apr 25 15:50:05 devstack cinder-volume[81828]: WARNING cinder.quota [None req-23bdb0b6-9f16-4aaa-81af-0a9c490a3d34 tempest-GroupSnapshotsV319Test-1816949060 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-588393113 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-588393113, it is now deprecated. Please use the default quota class for default quota. Apr 25 15:50:05 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-23bdb0b6-9f16-4aaa-81af-0a9c490a3d34 tempest-GroupSnapshotsV319Test-1816949060 None] Created reservations ['9d7d782e-5591-4f26-b457-6b9ac5d2ccdb', '54c92631-cd40-46d0-97c9-193ef6ad7c18', '5aa40b9a-d8ef-4450-9db8-d653f5195d64', '91344fe1-4c86-409a-8d9a-df5297020a76'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:50:06 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-23bdb0b6-9f16-4aaa-81af-0a9c490a3d34 tempest-GroupSnapshotsV319Test-1816949060 None] group_snapshot 40e58723-c34a-4193-b6af-a714cecff7af: deleted successfully Apr 25 15:50:06 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ebd130d4-8a51-41d7-acb6-577ee7f2988d tempest-AbsoluteLimitsTests-1598418906 None] Acquiring lock "cinder-bc0c029e-8e10-4748-af80-21737f656a02-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:50:06 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ebd130d4-8a51-41d7-acb6-577ee7f2988d tempest-AbsoluteLimitsTests-1598418906 None] Lock "cinder-bc0c029e-8e10-4748-af80-21737f656a02-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:50:06 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ebd130d4-8a51-41d7-acb6-577ee7f2988d tempest-AbsoluteLimitsTests-1598418906 None] Acquiring lock "cinder-quobyte-bc0c029e-8e10-4748-af80-21737f656a02" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:50:06 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ebd130d4-8a51-41d7-acb6-577ee7f2988d tempest-AbsoluteLimitsTests-1598418906 None] Lock "cinder-quobyte-bc0c029e-8e10-4748-af80-21737f656a02" acquired by "delete_volume" :: waited 0.016s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:50:06 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[2599b5bd-d1da-4e40-98d2-d9f15a75a306]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:50:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ebd130d4-8a51-41d7-acb6-577ee7f2988d tempest-AbsoluteLimitsTests-1598418906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bc0c029e-8e10-4748-af80-21737f656a02 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:06 devstack sudo[85605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bc0c029e-8e10-4748-af80-21737f656a02 Apr 25 15:50:06 devstack sudo[85605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:06 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-2d862305-4804-48ba-8ce3-5947d1633f65 tempest-GroupSnapshotsV319Test-1816949060 None] Acquiring lock "cinder-quobyte-43e5c84d-3604-425c-a791-4b1da0960665" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:50:06 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-2d862305-4804-48ba-8ce3-5947d1633f65 tempest-GroupSnapshotsV319Test-1816949060 None] Lock "cinder-quobyte-43e5c84d-3604-425c-a791-4b1da0960665" acquired by "delete_volume" :: waited 0.017s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:50:06 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbc3c75-5a27-4beb-b699-7d16babeaaf6]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:50:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2d862305-4804-48ba-8ce3-5947d1633f65 tempest-GroupSnapshotsV319Test-1816949060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:06 devstack sudo[85610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665 Apr 25 15:50:06 devstack sudo[85610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:06 devstack sudo[85605]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ebd130d4-8a51-41d7-acb6-577ee7f2988d tempest-AbsoluteLimitsTests-1598418906 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bc0c029e-8e10-4748-af80-21737f656a02" returned: 0 in 0.684s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ebd130d4-8a51-41d7-acb6-577ee7f2988d tempest-AbsoluteLimitsTests-1598418906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bc0c029e-8e10-4748-af80-21737f656a02 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:06 devstack sudo[85617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bc0c029e-8e10-4748-af80-21737f656a02 Apr 25 15:50:06 devstack sudo[85617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:07 devstack sudo[85610]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2d862305-4804-48ba-8ce3-5947d1633f65 tempest-GroupSnapshotsV319Test-1816949060 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665" returned: 0 in 0.739s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2d862305-4804-48ba-8ce3-5947d1633f65 tempest-GroupSnapshotsV319Test-1816949060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:07 devstack sudo[85622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665 Apr 25 15:50:07 devstack sudo[85622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:07 devstack sudo[85603]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_3nzuvq60devstack@QuobyteHD /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758" returned: 0 in 1.693s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:07 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_3nzuvq60devstack@QuobyteHD, size 112.00 MB, duration 1.69 sec, destination /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758 {{(pid=81828) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 15:50:07 devstack cinder-volume[81828]: INFO cinder.image.image_utils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Converted 112.00 MB image at 66.08 MB/s Apr 25 15:50:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:07 devstack sudo[85617]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:07 devstack sudo[85625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758 1G Apr 25 15:50:07 devstack sudo[85625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ebd130d4-8a51-41d7-acb6-577ee7f2988d tempest-AbsoluteLimitsTests-1598418906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bc0c029e-8e10-4748-af80-21737f656a02" returned: 0 in 0.683s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:07 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ebd130d4-8a51-41d7-acb6-577ee7f2988d tempest-AbsoluteLimitsTests-1598418906 None] Lock "cinder-quobyte-bc0c029e-8e10-4748-af80-21737f656a02" released by "delete_volume" :: held 1.413s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:50:07 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-5c553346-c4e1-4a33-b63a-1fe771f87daf tempest-GroupsV320Test-809139567 None] Created reservations ['16a0bb2c-c789-4d73-ba2f-e91204d39ec9'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:50:07 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-ebd130d4-8a51-41d7-acb6-577ee7f2988d tempest-AbsoluteLimitsTests-1598418906 None] Created reservations ['ee2d1494-6ce0-4ede-b5b7-f1f8f71d3c27', '85f7eec0-eaf4-4f8e-bae9-7358b22e31c1', 'b58c1cdc-7e05-4e9b-815d-5cca7bde6179', '7c311c9e-2367-4cb8-a0a5-80d9df591962'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:50:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-5c553346-c4e1-4a33-b63a-1fe771f87daf tempest-GroupsV320Test-809139567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:50:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-5c553346-c4e1-4a33-b63a-1fe771f87daf tempest-GroupsV320Test-809139567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:50:07 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-5c553346-c4e1-4a33-b63a-1fe771f87daf tempest-GroupsV320Test-809139567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:50:07 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-5c553346-c4e1-4a33-b63a-1fe771f87daf tempest-GroupsV320Test-809139567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:50:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-5c553346-c4e1-4a33-b63a-1fe771f87daf tempest-GroupsV320Test-809139567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:50:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5c553346-c4e1-4a33-b63a-1fe771f87daf tempest-GroupsV320Test-809139567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:07 devstack sudo[85628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:50:07 devstack sudo[85628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ebd130d4-8a51-41d7-acb6-577ee7f2988d tempest-AbsoluteLimitsTests-1598418906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:50:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ebd130d4-8a51-41d7-acb6-577ee7f2988d tempest-AbsoluteLimitsTests-1598418906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:50:07 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-ebd130d4-8a51-41d7-acb6-577ee7f2988d tempest-AbsoluteLimitsTests-1598418906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:50:07 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-ebd130d4-8a51-41d7-acb6-577ee7f2988d tempest-AbsoluteLimitsTests-1598418906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:50:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ebd130d4-8a51-41d7-acb6-577ee7f2988d tempest-AbsoluteLimitsTests-1598418906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:50:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ebd130d4-8a51-41d7-acb6-577ee7f2988d tempest-AbsoluteLimitsTests-1598418906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:07 devstack sudo[85630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:50:07 devstack sudo[85630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:07 devstack sudo[85622]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2d862305-4804-48ba-8ce3-5947d1633f65 tempest-GroupSnapshotsV319Test-1816949060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-43e5c84d-3604-425c-a791-4b1da0960665" returned: 0 in 0.572s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:07 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-2d862305-4804-48ba-8ce3-5947d1633f65 tempest-GroupSnapshotsV319Test-1816949060 None] Lock "cinder-quobyte-43e5c84d-3604-425c-a791-4b1da0960665" released by "delete_volume" :: held 1.380s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:50:07 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-2d862305-4804-48ba-8ce3-5947d1633f65 tempest-GroupSnapshotsV319Test-1816949060 None] Created reservations ['da7855a7-d494-4df0-9ad9-4208e22a191a'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:50:07 devstack cinder-volume[81828]: WARNING cinder.quota [None req-2d862305-4804-48ba-8ce3-5947d1633f65 tempest-GroupSnapshotsV319Test-1816949060 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-588393113 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-588393113, it is now deprecated. Please use the default quota class for default quota. Apr 25 15:50:07 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-2d862305-4804-48ba-8ce3-5947d1633f65 tempest-GroupSnapshotsV319Test-1816949060 None] Created reservations ['516132c1-b14a-405d-b422-51d544238ef7', 'ab6e99d6-25af-448b-84ae-9312fb72fa94', 'e969972c-2eec-4e5c-8cf6-76a2a467e6bd', 'ba8c5019-d32d-4282-a28a-a83fbed1911e'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:50:08 devstack sudo[85625]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758 1G" returned: 0 in 0.597s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-2d862305-4804-48ba-8ce3-5947d1633f65 tempest-GroupSnapshotsV319Test-1816949060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:50:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-2d862305-4804-48ba-8ce3-5947d1633f65 tempest-GroupSnapshotsV319Test-1816949060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:50:08 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-2d862305-4804-48ba-8ce3-5947d1633f65 tempest-GroupSnapshotsV319Test-1816949060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:50:08 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-2d862305-4804-48ba-8ce3-5947d1633f65 tempest-GroupSnapshotsV319Test-1816949060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:50:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-2d862305-4804-48ba-8ce3-5947d1633f65 tempest-GroupSnapshotsV319Test-1816949060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:50:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2d862305-4804-48ba-8ce3-5947d1633f65 tempest-GroupSnapshotsV319Test-1816949060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:08 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[67afd50c-f592-4463-a505-63af10f2f908]: (4, 'raw') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:50:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:08 devstack sudo[85635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:50:08 devstack sudo[85635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:08 devstack sudo[85637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758 Apr 25 15:50:08 devstack sudo[85637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:08 devstack sudo[85628]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5c553346-c4e1-4a33-b63a-1fe771f87daf tempest-GroupsV320Test-809139567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.506s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:08 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-5c553346-c4e1-4a33-b63a-1fe771f87daf tempest-GroupsV320Test-809139567 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:50:08 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-5c553346-c4e1-4a33-b63a-1fe771f87daf tempest-GroupsV320Test-809139567 None] Delete group completed successfully. Apr 25 15:50:08 devstack sudo[85630]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ebd130d4-8a51-41d7-acb6-577ee7f2988d tempest-AbsoluteLimitsTests-1598418906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.496s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:08 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-ebd130d4-8a51-41d7-acb6-577ee7f2988d tempest-AbsoluteLimitsTests-1598418906 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:50:08 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-ebd130d4-8a51-41d7-acb6-577ee7f2988d tempest-AbsoluteLimitsTests-1598418906 None] Deleted volume successfully. Apr 25 15:50:08 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ebd130d4-8a51-41d7-acb6-577ee7f2988d tempest-AbsoluteLimitsTests-1598418906 None] Lock "cinder-bc0c029e-8e10-4748-af80-21737f656a02-delete_volume" released by "delete_volume" :: held 2.196s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:50:08 devstack sudo[85635]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2d862305-4804-48ba-8ce3-5947d1633f65 tempest-GroupSnapshotsV319Test-1816949060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.560s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:08 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-2d862305-4804-48ba-8ce3-5947d1633f65 tempest-GroupSnapshotsV319Test-1816949060 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:50:08 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-2d862305-4804-48ba-8ce3-5947d1633f65 tempest-GroupSnapshotsV319Test-1816949060 None] Delete group completed successfully. Apr 25 15:50:08 devstack sudo[85637]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758" returned: 0 in 0.678s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:08 devstack sudo[85644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758 Apr 25 15:50:08 devstack sudo[85644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:09 devstack sudo[85644]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758" returned: 1 in 0.658s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758' failed. Not Retrying. {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 25 15:50:09 devstack cinder-volume[81828]: DEBUG cinder.volume.volume_utils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Downloaded image 4a29fc86-7ce4-447e-98ea-c141a6c39b3d ((None, [{'url': 'file:///opt/stack/data/glance/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'metadata': {}}])) to volume 303cc37b-c821-43ea-bf35-e142bcc73758 successfully. {{(pid=81828) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 25 15:50:09 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Temporary image 4a29fc86-7ce4-447e-98ea-c141a6c39b3d for user ca260fa0e18c49ec86bb079c4a7c0f8b is deleted. {{(pid=81828) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 25 15:50:09 devstack cinder-volume[81828]: DEBUG cinder.volume.volume_utils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Marking volume 303cc37b-c821-43ea-bf35-e142bcc73758 as bootable. {{(pid=81828) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 25 15:50:09 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Copying metadata from image 4a29fc86-7ce4-447e-98ea-c141a6c39b3d to 303cc37b-c821-43ea-bf35-e142bcc73758. {{(pid=81828) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 25 15:50:09 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Creating volume glance metadata for volume 303cc37b-c821-43ea-bf35-e142bcc73758 backed by image 4a29fc86-7ce4-447e-98ea-c141a6c39b3d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81828) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 25 15:50:09 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35244f37-67ba-4f53-b84b-33ed2f8d8259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-303cc37b-c821-43ea-bf35-e142bcc73758', 'volume_size': 1, 'image_id': '4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99560f74c63f4b9285294e59133188d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'created_at': datetime.datetime(2026, 4, 25, 13, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 13, 42, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:09 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88dbfbab-6d21-45b1-bfb3-c8787d5dd9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:09 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Volume volume-303cc37b-c821-43ea-bf35-e142bcc73758 (303cc37b-c821-43ea-bf35-e142bcc73758): created successfully Apr 25 15:50:09 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88dbfbab-6d21-45b1-bfb3-c8787d5dd9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:09 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Flow 'volume_create_manager' (7e21c63c-c033-4e5f-a3a7-fbb5f2f6936e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:50:09 devstack cinder-volume[81828]: INFO cinder.volume.manager [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-b75330aa-5e68-4139-b5c0-b81ac9e05ac9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Created volume successfully. Apr 25 15:50:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-4db15e36-6cff-45e8-801c-0928d5a6006e tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:50:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-4db15e36-6cff-45e8-801c-0928d5a6006e tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:50:12 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f04e1e7-b042-4646-8a72-10aa66ad5233]: (4, 'raw') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:50:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-4db15e36-6cff-45e8-801c-0928d5a6006e tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:12 devstack sudo[85693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758 Apr 25 15:50:12 devstack sudo[85693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:12 devstack sudo[85693]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-4db15e36-6cff-45e8-801c-0928d5a6006e tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758" returned: 0 in 0.748s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-4db15e36-6cff-45e8-801c-0928d5a6006e tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:12 devstack sudo[85697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758 Apr 25 15:50:12 devstack sudo[85697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:13 devstack sudo[85697]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-4db15e36-6cff-45e8-801c-0928d5a6006e tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758" returned: 1 in 0.669s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-4db15e36-6cff-45e8-801c-0928d5a6006e tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758' failed. Not Retrying. {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 25 15:50:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-4db15e36-6cff-45e8-801c-0928d5a6006e tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.485s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:50:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-4db15e36-6cff-45e8-801c-0928d5a6006e tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf', 'name': 'volume-303cc37b-c821-43ea-bf35-e142bcc73758', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '15a9bc27-40bf-40dc-bd36-7ef020b3234d', 'enforce_multipath': True} {{(pid=81828) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 25 15:50:13 devstack cinder-volume[81828]: INFO cinder.volume.manager [req-0b53f173-7eb3-431d-9ee1-aee9668482a9 req-4db15e36-6cff-45e8-801c-0928d5a6006e tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] attachment_update completed successfully. Apr 25 15:50:16 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:SELECT=160,cinder:UPDATE=158,cinder:DELETE=9,cinder:INSERT=51 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:50:16 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:50:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] Flow 'volume_create_manager' (9d2ff7d0-6507-4ae5-9556-56fcf4d3ca51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:50:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24d2dc3-c6b3-4803-a3be-f379f10f108c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24d2dc3-c6b3-4803-a3be-f379f10f108c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1813510033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c6ac644-caeb-45dd-8f49-12c7ba4f2f45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31be420f9e6b4e3b8a116df4f45ccb88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:50:16Z,use_quota=True,user_id='3dac302062f245009a8e95ec4401db1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b07bd69-aabd-4965-ae03-c0688e6087b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b07bd69-aabd-4965-ae03-c0688e6087b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd3dae2-2ac7-45fd-8a00-664bbb79eb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fd3dae2-2ac7-45fd-8a00-664bbb79eb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c6ac644-caeb-45dd-8f49-12c7ba4f2f45', 'volume_name': 'volume-6c6ac644-caeb-45dd-8f49-12c7ba4f2f45', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b32f17-198a-450b-9399-70e51e1528c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62b32f17-198a-450b-9399-70e51e1528c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d70f4cd5-dd2d-4632-a446-55df5e0bf3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:16 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] Volume 6c6ac644-caeb-45dd-8f49-12c7ba4f2f45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c6ac644-caeb-45dd-8f49-12c7ba4f2f45', 'volume_size': 1} Apr 25 15:50:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:50:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:50:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1813510033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c6ac644-caeb-45dd-8f49-12c7ba4f2f45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31be420f9e6b4e3b8a116df4f45ccb88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:50:16Z,use_quota=True,user_id='3dac302062f245009a8e95ec4401db1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:50:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] Creating volume 6c6ac644-caeb-45dd-8f49-12c7ba4f2f45 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:50:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:50:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:50:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:50:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:50:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:50:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:50:16 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:50:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c6ac644-caeb-45dd-8f49-12c7ba4f2f45 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:16 devstack sudo[85702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c6ac644-caeb-45dd-8f49-12c7ba4f2f45 1073741824 Apr 25 15:50:16 devstack sudo[85702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:17 devstack sudo[85702]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c6ac644-caeb-45dd-8f49-12c7ba4f2f45 1073741824" returned: 0 in 0.756s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c6ac644-caeb-45dd-8f49-12c7ba4f2f45 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:17 devstack sudo[85712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c6ac644-caeb-45dd-8f49-12c7ba4f2f45 Apr 25 15:50:17 devstack sudo[85712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:17 devstack sudo[85712]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c6ac644-caeb-45dd-8f49-12c7ba4f2f45" returned: 0 in 0.544s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:17 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] <== create_volume: return (1358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:50:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.360s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:50:17 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d70f4cd5-dd2d-4632-a446-55df5e0bf3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c6ac644-caeb-45dd-8f49-12c7ba4f2f45', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:17 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b3e20d-6a95-4812-a375-7306f1f0e7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:17 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] Volume volume-6c6ac644-caeb-45dd-8f49-12c7ba4f2f45 (6c6ac644-caeb-45dd-8f49-12c7ba4f2f45): created successfully Apr 25 15:50:17 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b3e20d-6a95-4812-a375-7306f1f0e7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:17 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] Flow 'volume_create_manager' (9d2ff7d0-6507-4ae5-9556-56fcf4d3ca51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:50:17 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-8b7e179e-dfcd-4a99-9fa2-357232321c1a tempest-VolumesTransfersTest-1622618349 None] Created volume successfully. Apr 25 15:50:19 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-c4d126e0-bf41-4fcd-a4c9-3cd2fa06a37b tempest-VolumesTransfersTest-1951963311 None] Transfer volume completed successfully. Apr 25 15:50:21 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b72a63e3-2462-4018-9a75-1b9bebcd2723 tempest-VolumesTransfersTest-1738531075 None] Acquiring lock "cinder-6c6ac644-caeb-45dd-8f49-12c7ba4f2f45-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:50:21 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b72a63e3-2462-4018-9a75-1b9bebcd2723 tempest-VolumesTransfersTest-1738531075 None] Lock "cinder-6c6ac644-caeb-45dd-8f49-12c7ba4f2f45-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:50:21 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b72a63e3-2462-4018-9a75-1b9bebcd2723 tempest-VolumesTransfersTest-1738531075 None] Acquiring lock "cinder-quobyte-6c6ac644-caeb-45dd-8f49-12c7ba4f2f45" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:50:21 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b72a63e3-2462-4018-9a75-1b9bebcd2723 tempest-VolumesTransfersTest-1738531075 None] Lock "cinder-quobyte-6c6ac644-caeb-45dd-8f49-12c7ba4f2f45" acquired by "delete_volume" :: waited 0.033s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:50:21 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3d5374-3d8c-4d4d-bdd4-395bb512e0f5]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:50:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b72a63e3-2462-4018-9a75-1b9bebcd2723 tempest-VolumesTransfersTest-1738531075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c6ac644-caeb-45dd-8f49-12c7ba4f2f45 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:21 devstack sudo[85761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c6ac644-caeb-45dd-8f49-12c7ba4f2f45 Apr 25 15:50:21 devstack sudo[85761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:22 devstack sudo[85761]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b72a63e3-2462-4018-9a75-1b9bebcd2723 tempest-VolumesTransfersTest-1738531075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c6ac644-caeb-45dd-8f49-12c7ba4f2f45" returned: 0 in 0.939s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b72a63e3-2462-4018-9a75-1b9bebcd2723 tempest-VolumesTransfersTest-1738531075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c6ac644-caeb-45dd-8f49-12c7ba4f2f45 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:22 devstack sudo[85766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c6ac644-caeb-45dd-8f49-12c7ba4f2f45 Apr 25 15:50:22 devstack sudo[85766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:22 devstack sudo[85766]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b72a63e3-2462-4018-9a75-1b9bebcd2723 tempest-VolumesTransfersTest-1738531075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6c6ac644-caeb-45dd-8f49-12c7ba4f2f45" returned: 0 in 0.584s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:22 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b72a63e3-2462-4018-9a75-1b9bebcd2723 tempest-VolumesTransfersTest-1738531075 None] Lock "cinder-quobyte-6c6ac644-caeb-45dd-8f49-12c7ba4f2f45" released by "delete_volume" :: held 1.587s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:50:22 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:UPDATE=140,cinder:SELECT=144,cinder:INSERT=48,cinder:DELETE=5 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:50:23 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-b72a63e3-2462-4018-9a75-1b9bebcd2723 tempest-VolumesTransfersTest-1738531075 None] Created reservations ['ce656080-d444-4549-bab2-74e2f75b5287', '02d686cd-cc2e-4ad7-b4b8-215431ecb359', '3068c680-4943-4b44-b7a7-0d742815be7c', '0308a9ef-0e41-4286-8011-8ff640e93875'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:50:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b72a63e3-2462-4018-9a75-1b9bebcd2723 tempest-VolumesTransfersTest-1738531075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:50:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b72a63e3-2462-4018-9a75-1b9bebcd2723 tempest-VolumesTransfersTest-1738531075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:50:23 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b72a63e3-2462-4018-9a75-1b9bebcd2723 tempest-VolumesTransfersTest-1738531075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:50:23 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b72a63e3-2462-4018-9a75-1b9bebcd2723 tempest-VolumesTransfersTest-1738531075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:50:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b72a63e3-2462-4018-9a75-1b9bebcd2723 tempest-VolumesTransfersTest-1738531075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:50:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b72a63e3-2462-4018-9a75-1b9bebcd2723 tempest-VolumesTransfersTest-1738531075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:23 devstack sudo[85770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:50:23 devstack sudo[85770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:24 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:50:24 devstack sudo[85770]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] Flow 'volume_create_manager' (e4c94d37-4207-444b-bf6b-8b169818b707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:50:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f43e0132-ccf0-4a67-848f-ad2194d26dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b72a63e3-2462-4018-9a75-1b9bebcd2723 tempest-VolumesTransfersTest-1738531075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 1.108s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:24 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-b72a63e3-2462-4018-9a75-1b9bebcd2723 tempest-VolumesTransfersTest-1738531075 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:50:24 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-b72a63e3-2462-4018-9a75-1b9bebcd2723 tempest-VolumesTransfersTest-1738531075 None] Deleted volume successfully. Apr 25 15:50:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f43e0132-ccf0-4a67-848f-ad2194d26dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1452834922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c2b31de-bc14-413d-a7e3-c3b6b29db0e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dbdf84db4fe4306a108b09568d81554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:50:24Z,use_quota=True,user_id='d692e074fa634d32af82be22eb3ef8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b46091e3-9ab3-41eb-a4cf-88f784403817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b46091e3-9ab3-41eb-a4cf-88f784403817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb9cbff8-4ed4-4c9e-97c4-05c12857d249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb9cbff8-4ed4-4c9e-97c4-05c12857d249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c2b31de-bc14-413d-a7e3-c3b6b29db0e0', 'volume_name': 'volume-8c2b31de-bc14-413d-a7e3-c3b6b29db0e0', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1381c5b3-2572-4590-80b2-f6e4d7092d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1381c5b3-2572-4590-80b2-f6e4d7092d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2f4401-eefb-47a1-9917-ad4ba1148d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:24 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] Volume 8c2b31de-bc14-413d-a7e3-c3b6b29db0e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c2b31de-bc14-413d-a7e3-c3b6b29db0e0', 'volume_size': 1} Apr 25 15:50:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:50:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:50:24 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1452834922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c2b31de-bc14-413d-a7e3-c3b6b29db0e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dbdf84db4fe4306a108b09568d81554',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:50:24Z,use_quota=True,user_id='d692e074fa634d32af82be22eb3ef8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:50:24 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] Creating volume 8c2b31de-bc14-413d-a7e3-c3b6b29db0e0 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:50:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:50:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:50:24 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:50:24 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:50:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:50:24 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:50:24 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:50:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c2b31de-bc14-413d-a7e3-c3b6b29db0e0 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:24 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b72a63e3-2462-4018-9a75-1b9bebcd2723 tempest-VolumesTransfersTest-1738531075 None] Lock "cinder-6c6ac644-caeb-45dd-8f49-12c7ba4f2f45-delete_volume" released by "delete_volume" :: held 3.162s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:50:24 devstack sudo[85775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c2b31de-bc14-413d-a7e3-c3b6b29db0e0 1073741824 Apr 25 15:50:24 devstack sudo[85775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:24 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:50:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] Flow 'volume_create_manager' (26bd7edb-7802-44ce-9a12-0176761f8ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:50:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f67774-f70b-4640-a01e-43047ec74e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f67774-f70b-4640-a01e-43047ec74e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-545714342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d49fe0df-0f88-4336-b440-e45ff46156ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31be420f9e6b4e3b8a116df4f45ccb88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:50:25Z,use_quota=True,user_id='3dac302062f245009a8e95ec4401db1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c89bf9fa-fce0-462c-bf28-3c716da809bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c89bf9fa-fce0-462c-bf28-3c716da809bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10419975-37e0-43af-b5fe-27aa6458290a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10419975-37e0-43af-b5fe-27aa6458290a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd49fe0df-0f88-4336-b440-e45ff46156ef', 'volume_name': 'volume-d49fe0df-0f88-4336-b440-e45ff46156ef', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89abfc5b-78c0-467d-b9b0-b5213f37a19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89abfc5b-78c0-467d-b9b0-b5213f37a19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e91b012b-a090-4d88-b59e-ece4fcb38bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:25 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] Volume d49fe0df-0f88-4336-b440-e45ff46156ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d49fe0df-0f88-4336-b440-e45ff46156ef', 'volume_size': 1} Apr 25 15:50:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:50:25 devstack sudo[85775]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c2b31de-bc14-413d-a7e3-c3b6b29db0e0 1073741824" returned: 0 in 1.311s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c2b31de-bc14-413d-a7e3-c3b6b29db0e0 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:25 devstack sudo[85780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c2b31de-bc14-413d-a7e3-c3b6b29db0e0 Apr 25 15:50:25 devstack sudo[85780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:26 devstack sudo[85780]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c2b31de-bc14-413d-a7e3-c3b6b29db0e0" returned: 0 in 0.812s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:26 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] <== create_volume: return (2196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:50:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.202s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:50:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.494s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:50:26 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-545714342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d49fe0df-0f88-4336-b440-e45ff46156ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31be420f9e6b4e3b8a116df4f45ccb88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:50:25Z,use_quota=True,user_id='3dac302062f245009a8e95ec4401db1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:50:26 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] Creating volume d49fe0df-0f88-4336-b440-e45ff46156ef {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:50:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:50:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:50:26 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:50:26 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:50:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:50:26 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:50:26 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:50:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d49fe0df-0f88-4336-b440-e45ff46156ef 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b2f4401-eefb-47a1-9917-ad4ba1148d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c2b31de-bc14-413d-a7e3-c3b6b29db0e0', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfecd6bb-db02-44a8-aab2-f811ca79fb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:26 devstack sudo[85785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d49fe0df-0f88-4336-b440-e45ff46156ef 1073741824 Apr 25 15:50:26 devstack sudo[85785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:26 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] Volume volume-8c2b31de-bc14-413d-a7e3-c3b6b29db0e0 (8c2b31de-bc14-413d-a7e3-c3b6b29db0e0): created successfully Apr 25 15:50:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfecd6bb-db02-44a8-aab2-f811ca79fb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] Flow 'volume_create_manager' (e4c94d37-4207-444b-bf6b-8b169818b707) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:50:26 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-53645e50-af10-4c2f-b6ca-9bec71ccab3e tempest-VolumeQuotasNegativeTestJSON-694999332 None] Created volume successfully. Apr 25 15:50:27 devstack sudo[85785]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d49fe0df-0f88-4336-b440-e45ff46156ef 1073741824" returned: 0 in 0.972s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d49fe0df-0f88-4336-b440-e45ff46156ef {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:27 devstack sudo[85797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d49fe0df-0f88-4336-b440-e45ff46156ef Apr 25 15:50:27 devstack sudo[85797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:28 devstack sudo[85797]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d49fe0df-0f88-4336-b440-e45ff46156ef" returned: 0 in 0.972s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:28 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] <== create_volume: return (1996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:50:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.004s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:50:28 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e91b012b-a090-4d88-b59e-ece4fcb38bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d49fe0df-0f88-4336-b440-e45ff46156ef', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:28 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de092a8-2663-421d-9ecf-f6e5256d27a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:28 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] Volume volume-d49fe0df-0f88-4336-b440-e45ff46156ef (d49fe0df-0f88-4336-b440-e45ff46156ef): created successfully Apr 25 15:50:28 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6de092a8-2663-421d-9ecf-f6e5256d27a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:28 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] Flow 'volume_create_manager' (26bd7edb-7802-44ce-9a12-0176761f8ab8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:50:28 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-e4726d0e-25e0-46eb-a92e-368ca0f88132 tempest-VolumesTransfersTest-1622618349 None] Created volume successfully. Apr 25 15:50:29 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-94e80e8e-fcbd-4b74-9045-aa47a428c7d8 tempest-VolumeQuotasNegativeTestJSON-694999332 None] Acquiring lock "cinder-8c2b31de-bc14-413d-a7e3-c3b6b29db0e0-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:50:29 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-94e80e8e-fcbd-4b74-9045-aa47a428c7d8 tempest-VolumeQuotasNegativeTestJSON-694999332 None] Lock "cinder-8c2b31de-bc14-413d-a7e3-c3b6b29db0e0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:50:29 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-94e80e8e-fcbd-4b74-9045-aa47a428c7d8 tempest-VolumeQuotasNegativeTestJSON-694999332 None] Acquiring lock "cinder-quobyte-8c2b31de-bc14-413d-a7e3-c3b6b29db0e0" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:50:29 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-94e80e8e-fcbd-4b74-9045-aa47a428c7d8 tempest-VolumeQuotasNegativeTestJSON-694999332 None] Lock "cinder-quobyte-8c2b31de-bc14-413d-a7e3-c3b6b29db0e0" acquired by "delete_volume" :: waited 0.029s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:50:29 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[4605e58a-d4da-4feb-b7aa-c12fb41ddd70]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:50:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-94e80e8e-fcbd-4b74-9045-aa47a428c7d8 tempest-VolumeQuotasNegativeTestJSON-694999332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c2b31de-bc14-413d-a7e3-c3b6b29db0e0 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:29 devstack sudo[85806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c2b31de-bc14-413d-a7e3-c3b6b29db0e0 Apr 25 15:50:29 devstack sudo[85806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:29 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b383e1b0-92ad-4036-8914-117ca8920bdc tempest-VolumesTransfersTest-1738531075 None] Acquiring lock "cinder-d49fe0df-0f88-4336-b440-e45ff46156ef-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:50:29 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b383e1b0-92ad-4036-8914-117ca8920bdc tempest-VolumesTransfersTest-1738531075 None] Lock "cinder-d49fe0df-0f88-4336-b440-e45ff46156ef-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:50:29 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b383e1b0-92ad-4036-8914-117ca8920bdc tempest-VolumesTransfersTest-1738531075 None] Acquiring lock "cinder-quobyte-d49fe0df-0f88-4336-b440-e45ff46156ef" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:50:29 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b383e1b0-92ad-4036-8914-117ca8920bdc tempest-VolumesTransfersTest-1738531075 None] Lock "cinder-quobyte-d49fe0df-0f88-4336-b440-e45ff46156ef" acquired by "delete_volume" :: waited 0.016s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:50:29 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6b7bc8-c297-4816-91f2-befca5e5a0a5]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:50:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b383e1b0-92ad-4036-8914-117ca8920bdc tempest-VolumesTransfersTest-1738531075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d49fe0df-0f88-4336-b440-e45ff46156ef {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:30 devstack sudo[85814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d49fe0df-0f88-4336-b440-e45ff46156ef Apr 25 15:50:30 devstack sudo[85814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:30 devstack sudo[85806]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-94e80e8e-fcbd-4b74-9045-aa47a428c7d8 tempest-VolumeQuotasNegativeTestJSON-694999332 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c2b31de-bc14-413d-a7e3-c3b6b29db0e0" returned: 0 in 1.046s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-94e80e8e-fcbd-4b74-9045-aa47a428c7d8 tempest-VolumeQuotasNegativeTestJSON-694999332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c2b31de-bc14-413d-a7e3-c3b6b29db0e0 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:30 devstack sudo[85840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c2b31de-bc14-413d-a7e3-c3b6b29db0e0 Apr 25 15:50:30 devstack sudo[85840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:30 devstack sudo[85814]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b383e1b0-92ad-4036-8914-117ca8920bdc tempest-VolumesTransfersTest-1738531075 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d49fe0df-0f88-4336-b440-e45ff46156ef" returned: 0 in 0.897s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b383e1b0-92ad-4036-8914-117ca8920bdc tempest-VolumesTransfersTest-1738531075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d49fe0df-0f88-4336-b440-e45ff46156ef {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:30 devstack sudo[85846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d49fe0df-0f88-4336-b440-e45ff46156ef Apr 25 15:50:30 devstack sudo[85846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:31 devstack sudo[85840]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-94e80e8e-fcbd-4b74-9045-aa47a428c7d8 tempest-VolumeQuotasNegativeTestJSON-694999332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8c2b31de-bc14-413d-a7e3-c3b6b29db0e0" returned: 0 in 0.633s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:31 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-94e80e8e-fcbd-4b74-9045-aa47a428c7d8 tempest-VolumeQuotasNegativeTestJSON-694999332 None] Lock "cinder-quobyte-8c2b31de-bc14-413d-a7e3-c3b6b29db0e0" released by "delete_volume" :: held 1.771s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:50:31 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-94e80e8e-fcbd-4b74-9045-aa47a428c7d8 tempest-VolumeQuotasNegativeTestJSON-694999332 None] Created reservations ['593603b5-4a47-4d9f-9071-791d5a1c5313', 'a5ec35a9-ced0-4f22-acf8-a2ef66d37c93', '10dc185f-d5fc-45fe-bf17-b27e18f714af', 'dea52202-0f0d-4ae8-bce5-cb93460c995c'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:50:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-94e80e8e-fcbd-4b74-9045-aa47a428c7d8 tempest-VolumeQuotasNegativeTestJSON-694999332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:50:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-94e80e8e-fcbd-4b74-9045-aa47a428c7d8 tempest-VolumeQuotasNegativeTestJSON-694999332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:50:31 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-94e80e8e-fcbd-4b74-9045-aa47a428c7d8 tempest-VolumeQuotasNegativeTestJSON-694999332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:50:31 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-94e80e8e-fcbd-4b74-9045-aa47a428c7d8 tempest-VolumeQuotasNegativeTestJSON-694999332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:50:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-94e80e8e-fcbd-4b74-9045-aa47a428c7d8 tempest-VolumeQuotasNegativeTestJSON-694999332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:50:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-94e80e8e-fcbd-4b74-9045-aa47a428c7d8 tempest-VolumeQuotasNegativeTestJSON-694999332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:31 devstack sudo[85851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:50:31 devstack sudo[85851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:31 devstack sudo[85846]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b383e1b0-92ad-4036-8914-117ca8920bdc tempest-VolumesTransfersTest-1738531075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d49fe0df-0f88-4336-b440-e45ff46156ef" returned: 0 in 0.509s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:31 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b383e1b0-92ad-4036-8914-117ca8920bdc tempest-VolumesTransfersTest-1738531075 None] Lock "cinder-quobyte-d49fe0df-0f88-4336-b440-e45ff46156ef" released by "delete_volume" :: held 1.473s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:50:31 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-b383e1b0-92ad-4036-8914-117ca8920bdc tempest-VolumesTransfersTest-1738531075 None] Created reservations ['2b8e0ea6-b59c-458d-a750-cb27942bca25', '1b473bc0-0f2b-401e-af14-14447cda0881', 'e5e4ab81-5f61-4ba7-859b-c1911a5a1971', '2631e8b4-d21b-44da-b78a-ac2329a802cf'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:50:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b383e1b0-92ad-4036-8914-117ca8920bdc tempest-VolumesTransfersTest-1738531075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:50:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b383e1b0-92ad-4036-8914-117ca8920bdc tempest-VolumesTransfersTest-1738531075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:50:31 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b383e1b0-92ad-4036-8914-117ca8920bdc tempest-VolumesTransfersTest-1738531075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:50:31 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b383e1b0-92ad-4036-8914-117ca8920bdc tempest-VolumesTransfersTest-1738531075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:50:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b383e1b0-92ad-4036-8914-117ca8920bdc tempest-VolumesTransfersTest-1738531075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:50:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b383e1b0-92ad-4036-8914-117ca8920bdc tempest-VolumesTransfersTest-1738531075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:31 devstack sudo[85853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:50:31 devstack sudo[85853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:32 devstack sudo[85851]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-94e80e8e-fcbd-4b74-9045-aa47a428c7d8 tempest-VolumeQuotasNegativeTestJSON-694999332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.725s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:32 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-94e80e8e-fcbd-4b74-9045-aa47a428c7d8 tempest-VolumeQuotasNegativeTestJSON-694999332 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:50:32 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-94e80e8e-fcbd-4b74-9045-aa47a428c7d8 tempest-VolumeQuotasNegativeTestJSON-694999332 None] Deleted volume successfully. Apr 25 15:50:32 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-94e80e8e-fcbd-4b74-9045-aa47a428c7d8 tempest-VolumeQuotasNegativeTestJSON-694999332 None] Lock "cinder-8c2b31de-bc14-413d-a7e3-c3b6b29db0e0-delete_volume" released by "delete_volume" :: held 2.853s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:50:32 devstack sudo[85853]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b383e1b0-92ad-4036-8914-117ca8920bdc tempest-VolumesTransfersTest-1738531075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.871s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:32 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-b383e1b0-92ad-4036-8914-117ca8920bdc tempest-VolumesTransfersTest-1738531075 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:50:32 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-b383e1b0-92ad-4036-8914-117ca8920bdc tempest-VolumesTransfersTest-1738531075 None] Deleted volume successfully. Apr 25 15:50:32 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b383e1b0-92ad-4036-8914-117ca8920bdc tempest-VolumesTransfersTest-1738531075 None] Lock "cinder-d49fe0df-0f88-4336-b440-e45ff46156ef-delete_volume" released by "delete_volume" :: held 2.639s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Flow 'volume_create_manager' (4048aba8-d2d6-4ba7-bad7-834a74ed0bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5130e032-6117-4922-ae18-8d2f837a9663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5130e032-6117-4922-ae18-8d2f837a9663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-365081876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb652f62-a6e4-44b6-8d87-61fb6858d7e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='175c766d7503464fa6f3ce38453cb69d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:50:40Z,use_quota=True,user_id='eb8cdf1544af4481a00f563601781044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1da9052e-9775-4bfc-927f-6cb9339c7bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1da9052e-9775-4bfc-927f-6cb9339c7bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9768e2ab-465a-4dd4-9fd3-582f78786cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9768e2ab-465a-4dd4-9fd3-582f78786cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb652f62-a6e4-44b6-8d87-61fb6858d7e9', 'volume_name': 'volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f4c874f-bcb1-4f1c-ae04-7c33b8e6bbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f4c874f-bcb1-4f1c-ae04-7c33b8e6bbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3206e5a7-1c8b-41b1-ae21-7c1c02a05cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:40 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Volume eb652f62-a6e4-44b6-8d87-61fb6858d7e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9', 'volume_size': 1} Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-365081876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb652f62-a6e4-44b6-8d87-61fb6858d7e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='175c766d7503464fa6f3ce38453cb69d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:50:40Z,use_quota=True,user_id='eb8cdf1544af4481a00f563601781044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Creating volume eb652f62-a6e4-44b6-8d87-61fb6858d7e9 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:50:40 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] Flow 'volume_create_manager' (baedb9cf-7191-43d8-a010-79f6f97bdb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:50:40 devstack sudo[85929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9 1073741824 Apr 25 15:50:40 devstack sudo[85929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bc00f28-8670-4856-84ae-97d09a395fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bc00f28-8670-4856-84ae-97d09a395fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-15954573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62cc2b67-9252-4f7b-afe5-b1d943e2f4fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf36a024614849bfb68ad0a1384263bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:50:41Z,use_quota=True,user_id='dcb91490ee174187b0a407d2e6725bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e4c134-80e2-4826-b827-985e22883121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e4c134-80e2-4826-b827-985e22883121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (826fa9db-a999-4dea-8314-1ea945b3efb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (826fa9db-a999-4dea-8314-1ea945b3efb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62cc2b67-9252-4f7b-afe5-b1d943e2f4fe', 'volume_name': 'volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9924b050-e735-4b57-9e00-1c951e99ffb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9924b050-e735-4b57-9e00-1c951e99ffb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (108d6a81-3a21-41f4-9d5d-7422b6dbfae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:40 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] Volume 62cc2b67-9252-4f7b-afe5-b1d943e2f4fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe', 'volume_size': 1} Apr 25 15:50:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:50:41 devstack sudo[85929]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9 1073741824" returned: 0 in 1.154s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:41 devstack sudo[85937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9 Apr 25 15:50:41 devstack sudo[85937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:42 devstack sudo[85937]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9" returned: 0 in 0.521s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:42 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:50:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.741s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:50:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.622s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:50:42 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-15954573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62cc2b67-9252-4f7b-afe5-b1d943e2f4fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf36a024614849bfb68ad0a1384263bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:50:41Z,use_quota=True,user_id='dcb91490ee174187b0a407d2e6725bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:50:42 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] Creating volume 62cc2b67-9252-4f7b-afe5-b1d943e2f4fe {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:50:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:50:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:50:42 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:50:42 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:50:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:50:42 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:50:42 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:50:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3206e5a7-1c8b-41b1-ae21-7c1c02a05cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d97079f-311c-4300-80ef-9011c9b4d290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:42 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Volume volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9 (eb652f62-a6e4-44b6-8d87-61fb6858d7e9): created successfully Apr 25 15:50:42 devstack sudo[85940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe 1073741824 Apr 25 15:50:42 devstack sudo[85940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d97079f-311c-4300-80ef-9011c9b4d290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Flow 'volume_create_manager' (4048aba8-d2d6-4ba7-bad7-834a74ed0bf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:50:42 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-032e0335-c8a4-4419-9045-dcc6bdb5bd31 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Created volume successfully. Apr 25 15:50:43 devstack sudo[85940]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe 1073741824" returned: 0 in 0.972s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:43 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:50:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] Flow 'volume_create_manager' (e50d8024-305f-4be5-974f-d32ce3db45d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:50:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5c0e58-554f-4e1d-a6b9-37f72708594b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:43 devstack sudo[85947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe Apr 25 15:50:43 devstack sudo[85947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5c0e58-554f-4e1d-a6b9-37f72708594b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-677571178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff5e7cbb-24d0-4bda-9612-e1e0e78bf58c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4163408d2424e0895322c7db79f2bac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:50:43Z,use_quota=True,user_id='53545a77f6fd44ceb986aff5580adb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06c36b26-756c-4d50-b7a8-fe1aa22ae577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06c36b26-756c-4d50-b7a8-fe1aa22ae577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20c52fb-2fe2-4447-8a3d-193b423051cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20c52fb-2fe2-4447-8a3d-193b423051cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff5e7cbb-24d0-4bda-9612-e1e0e78bf58c', 'volume_name': 'volume-ff5e7cbb-24d0-4bda-9612-e1e0e78bf58c', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4c04ef9-c250-4268-bea3-41ec584cdf47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4c04ef9-c250-4268-bea3-41ec584cdf47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f576ebd-20d0-4a19-aa85-c81e4502af31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:43 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] Volume ff5e7cbb-24d0-4bda-9612-e1e0e78bf58c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff5e7cbb-24d0-4bda-9612-e1e0e78bf58c', 'volume_size': 1} Apr 25 15:50:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:50:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-a76c70bc-97fc-49b4-8b86-b1886f1c0d45 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:50:44 devstack sudo[85947]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe" returned: 0 in 0.540s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:50:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:50:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.489s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:50:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:50:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-677571178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff5e7cbb-24d0-4bda-9612-e1e0e78bf58c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4163408d2424e0895322c7db79f2bac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:50:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:50:43Z,use_quota=True,user_id='53545a77f6fd44ceb986aff5580adb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:50:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] Creating volume ff5e7cbb-24d0-4bda-9612-e1e0e78bf58c {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:50:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:50:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:50:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:50:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:50:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:50:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:50:44 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:50:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff5e7cbb-24d0-4bda-9612-e1e0e78bf58c 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (108d6a81-3a21-41f4-9d5d-7422b6dbfae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03a32b09-e47c-48ae-9c59-d78e66ccccd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:44 devstack sudo[85951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff5e7cbb-24d0-4bda-9612-e1e0e78bf58c 1073741824 Apr 25 15:50:44 devstack sudo[85951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:44 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] Volume volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe (62cc2b67-9252-4f7b-afe5-b1d943e2f4fe): created successfully Apr 25 15:50:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03a32b09-e47c-48ae-9c59-d78e66ccccd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] Flow 'volume_create_manager' (baedb9cf-7191-43d8-a010-79f6f97bdb98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:50:44 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-26594c52-bf2a-4d52-ace8-b9cfff519393 tempest-VolumesCloneTest-1247357815 None] Created volume successfully. Apr 25 15:50:44 devstack sudo[85951]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff5e7cbb-24d0-4bda-9612-e1e0e78bf58c 1073741824" returned: 0 in 0.886s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff5e7cbb-24d0-4bda-9612-e1e0e78bf58c {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:45 devstack sudo[85986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff5e7cbb-24d0-4bda-9612-e1e0e78bf58c Apr 25 15:50:45 devstack sudo[85986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:45 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:50:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Flow 'volume_create_manager' (60e01048-b43e-43df-89ff-ced75d8d1b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:50:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (431e17b1-1ce1-4729-b633-166b43f3f323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (431e17b1-1ce1-4729-b633-166b43f3f323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:50:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1810465607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b12dedb-66c1-4a20-9453-adb451d8cd3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf36a024614849bfb68ad0a1384263bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:50:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=62cc2b67-9252-4f7b-afe5-b1d943e2f4fe,status='creating',terminated_at=None,updated_at=2026-04-25T13:50:45Z,use_quota=True,user_id='dcb91490ee174187b0a407d2e6725bdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f53d570a-ef2f-4284-9041-03fb43dcb193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f53d570a-ef2f-4284-9041-03fb43dcb193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c4d0687-fcbe-4d1e-8f69-437d2471a5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c4d0687-fcbe-4d1e-8f69-437d2471a5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6b12dedb-66c1-4a20-9453-adb451d8cd3a', 'volume_name': 'volume-6b12dedb-66c1-4a20-9453-adb451d8cd3a', 'volume_size': 2, 'source_volid': '62cc2b67-9252-4f7b-afe5-b1d943e2f4fe', 'source_volstatus': 'available'}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a26c686-6599-43a7-a9b7-e560501ce373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a26c686-6599-43a7-a9b7-e560501ce373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af159c92-2848-44b4-8d60-464b3510c253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:45 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Volume 6b12dedb-66c1-4a20-9453-adb451d8cd3a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6b12dedb-66c1-4a20-9453-adb451d8cd3a', 'volume_size': 2, 'source_volid': '62cc2b67-9252-4f7b-afe5-b1d943e2f4fe', 'source_volstatus': 'available'} Apr 25 15:50:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:50:45 devstack sudo[85986]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff5e7cbb-24d0-4bda-9612-e1e0e78bf58c" returned: 0 in 0.523s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:45 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] <== create_volume: return (1449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:50:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:50:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-a76c70bc-97fc-49b4-8b86-b1886f1c0d45 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.618s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:50:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f576ebd-20d0-4a19-aa85-c81e4502af31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff5e7cbb-24d0-4bda-9612-e1e0e78bf58c', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6f6046-b34f-4337-90fc-46f28e5ec520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:45 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-a76c70bc-97fc-49b4-8b86-b1886f1c0d45 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Creating offline snapshot f001c79d-7fd9-410d-a908-c79c8373f183 of volume eb652f62-a6e4-44b6-8d87-61fb6858d7e9 {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 15:50:45 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] Volume volume-ff5e7cbb-24d0-4bda-9612-e1e0e78bf58c (ff5e7cbb-24d0-4bda-9612-e1e0e78bf58c): created successfully Apr 25 15:50:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6f6046-b34f-4337-90fc-46f28e5ec520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] Flow 'volume_create_manager' (e50d8024-305f-4be5-974f-d32ce3db45d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:50:45 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[302ce84e-c593-47c0-b3b8-b245ea8d1516]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:50:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a76c70bc-97fc-49b4-8b86-b1886f1c0d45 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:45 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-e8e67cf1-2374-455f-8d73-b3f0ffef93ad tempest-VolumeQuotasAdminTestJSON-851585472 None] Created volume successfully. Apr 25 15:50:45 devstack sudo[85994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9 Apr 25 15:50:45 devstack sudo[85994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:45 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f684738d-1890-4475-a9a2-98f6b465c78b tempest-VolumeQuotasAdminTestJSON-851585472 None] Acquiring lock "cinder-ff5e7cbb-24d0-4bda-9612-e1e0e78bf58c-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:50:45 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f684738d-1890-4475-a9a2-98f6b465c78b tempest-VolumeQuotasAdminTestJSON-851585472 None] Lock "cinder-ff5e7cbb-24d0-4bda-9612-e1e0e78bf58c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:50:45 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f684738d-1890-4475-a9a2-98f6b465c78b tempest-VolumeQuotasAdminTestJSON-851585472 None] Acquiring lock "cinder-quobyte-ff5e7cbb-24d0-4bda-9612-e1e0e78bf58c" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:50:45 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f684738d-1890-4475-a9a2-98f6b465c78b tempest-VolumeQuotasAdminTestJSON-851585472 None] Lock "cinder-quobyte-ff5e7cbb-24d0-4bda-9612-e1e0e78bf58c" acquired by "delete_volume" :: waited 0.033s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:50:45 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc02cbf5-e55e-4d3b-b967-3dfd2d3570f1]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:50:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f684738d-1890-4475-a9a2-98f6b465c78b tempest-VolumeQuotasAdminTestJSON-851585472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff5e7cbb-24d0-4bda-9612-e1e0e78bf58c {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:46 devstack sudo[85998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff5e7cbb-24d0-4bda-9612-e1e0e78bf58c Apr 25 15:50:46 devstack sudo[85998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:46 devstack sudo[85994]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a76c70bc-97fc-49b4-8b86-b1886f1c0d45 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9" returned: 0 in 0.713s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a76c70bc-97fc-49b4-8b86-b1886f1c0d45 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9.f001c79d-7fd9-410d-a908-c79c8373f183 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:46 devstack sudo[86010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9.f001c79d-7fd9-410d-a908-c79c8373f183 1G Apr 25 15:50:46 devstack sudo[86010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:46 devstack sudo[85998]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f684738d-1890-4475-a9a2-98f6b465c78b tempest-VolumeQuotasAdminTestJSON-851585472 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff5e7cbb-24d0-4bda-9612-e1e0e78bf58c" returned: 0 in 0.553s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f684738d-1890-4475-a9a2-98f6b465c78b tempest-VolumeQuotasAdminTestJSON-851585472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff5e7cbb-24d0-4bda-9612-e1e0e78bf58c {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:46 devstack sudo[86017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff5e7cbb-24d0-4bda-9612-e1e0e78bf58c Apr 25 15:50:46 devstack sudo[86017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:47 devstack sudo[86017]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f684738d-1890-4475-a9a2-98f6b465c78b tempest-VolumeQuotasAdminTestJSON-851585472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff5e7cbb-24d0-4bda-9612-e1e0e78bf58c" returned: 0 in 0.597s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:47 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f684738d-1890-4475-a9a2-98f6b465c78b tempest-VolumeQuotasAdminTestJSON-851585472 None] Lock "cinder-quobyte-ff5e7cbb-24d0-4bda-9612-e1e0e78bf58c" released by "delete_volume" :: held 1.208s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:50:47 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-f684738d-1890-4475-a9a2-98f6b465c78b tempest-VolumeQuotasAdminTestJSON-851585472 None] Created reservations ['8b918620-017b-4371-aa41-f18772a3df8c', 'e4fc3da6-ffc1-4606-924a-b333c8a5cb49', '4ce601ad-e84c-450c-9404-f6370d62c5f2', 'e77fd229-d921-4259-9abd-f3f2c17c8bfe'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:50:47 devstack sudo[86010]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a76c70bc-97fc-49b4-8b86-b1886f1c0d45 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9.f001c79d-7fd9-410d-a908-c79c8373f183 1G" returned: 0 in 0.926s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a76c70bc-97fc-49b4-8b86-b1886f1c0d45 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9.f001c79d-7fd9-410d-a908-c79c8373f183 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:47 devstack sudo[86049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9.f001c79d-7fd9-410d-a908-c79c8373f183 Apr 25 15:50:47 devstack sudo[86049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f684738d-1890-4475-a9a2-98f6b465c78b tempest-VolumeQuotasAdminTestJSON-851585472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:50:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f684738d-1890-4475-a9a2-98f6b465c78b tempest-VolumeQuotasAdminTestJSON-851585472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:50:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f684738d-1890-4475-a9a2-98f6b465c78b tempest-VolumeQuotasAdminTestJSON-851585472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:50:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f684738d-1890-4475-a9a2-98f6b465c78b tempest-VolumeQuotasAdminTestJSON-851585472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:50:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f684738d-1890-4475-a9a2-98f6b465c78b tempest-VolumeQuotasAdminTestJSON-851585472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:50:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f684738d-1890-4475-a9a2-98f6b465c78b tempest-VolumeQuotasAdminTestJSON-851585472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:47 devstack sudo[86052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:50:47 devstack sudo[86052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:47 devstack sudo[86052]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f684738d-1890-4475-a9a2-98f6b465c78b tempest-VolumeQuotasAdminTestJSON-851585472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.546s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:47 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-f684738d-1890-4475-a9a2-98f6b465c78b tempest-VolumeQuotasAdminTestJSON-851585472 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:50:47 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-f684738d-1890-4475-a9a2-98f6b465c78b tempest-VolumeQuotasAdminTestJSON-851585472 None] Deleted volume successfully. Apr 25 15:50:47 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f684738d-1890-4475-a9a2-98f6b465c78b tempest-VolumeQuotasAdminTestJSON-851585472 None] Lock "cinder-ff5e7cbb-24d0-4bda-9612-e1e0e78bf58c-delete_volume" released by "delete_volume" :: held 2.060s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:50:47 devstack sudo[86049]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a76c70bc-97fc-49b4-8b86-b1886f1c0d45 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9.f001c79d-7fd9-410d-a908-c79c8373f183" returned: 0 in 0.672s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:47 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-a76c70bc-97fc-49b4-8b86-b1886f1c0d45 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9.f001c79d-7fd9-410d-a908-c79c8373f183 is being set with open permissions: ugo+rw Apr 25 15:50:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a76c70bc-97fc-49b4-8b86-b1886f1c0d45 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9.f001c79d-7fd9-410d-a908-c79c8373f183 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:47 devstack sudo[86067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9.f001c79d-7fd9-410d-a908-c79c8373f183 Apr 25 15:50:47 devstack sudo[86067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:48 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:50:48 devstack sudo[86067]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] Flow 'volume_create_manager' (35b764b5-3976-49d1-bac6-47199a6b39f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:50:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25312c4-058b-4495-9295-2fa40e7cb25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25312c4-058b-4495-9295-2fa40e7cb25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1812329112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbe3b2ed-f34d-4fc4-9cb1-f91647f42634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4163408d2424e0895322c7db79f2bac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:50:49Z,use_quota=True,user_id='53545a77f6fd44ceb986aff5580adb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (588998ae-61da-4ba2-9460-39d871d7bff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (588998ae-61da-4ba2-9460-39d871d7bff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b9bb32e-9899-4a1c-8d7a-3ab4772b7625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b9bb32e-9899-4a1c-8d7a-3ab4772b7625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbe3b2ed-f34d-4fc4-9cb1-f91647f42634', 'volume_name': 'volume-fbe3b2ed-f34d-4fc4-9cb1-f91647f42634', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14cca01b-df02-41ef-8747-84da3274a775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14cca01b-df02-41ef-8747-84da3274a775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:50:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8349862e-8544-455a-a495-07bb31f78bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:50:48 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] Volume fbe3b2ed-f34d-4fc4-9cb1-f91647f42634: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbe3b2ed-f34d-4fc4-9cb1-f91647f42634', 'volume_size': 1} Apr 25 15:50:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:50:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a76c70bc-97fc-49b4-8b86-b1886f1c0d45 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9.f001c79d-7fd9-410d-a908-c79c8373f183" returned: 0 in 0.763s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a76c70bc-97fc-49b4-8b86-b1886f1c0d45 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:48 devstack sudo[86070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9.info Apr 25 15:50:48 devstack sudo[86070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:49 devstack sudo[86070]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a76c70bc-97fc-49b4-8b86-b1886f1c0d45 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9.info" returned: 0 in 0.621s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:49 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-a76c70bc-97fc-49b4-8b86-b1886f1c0d45 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9.info is being set with open permissions: ugo+rw Apr 25 15:50:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a76c70bc-97fc-49b4-8b86-b1886f1c0d45 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:49 devstack sudo[86075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9.info Apr 25 15:50:49 devstack sudo[86075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:49 devstack sudo[86075]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a76c70bc-97fc-49b4-8b86-b1886f1c0d45 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9.info" returned: 0 in 0.490s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-a76c70bc-97fc-49b4-8b86-b1886f1c0d45 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.303s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:50:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.441s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:50:49 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Cloning volume 62cc2b67-9252-4f7b-afe5-b1d943e2f4fe to volume 6b12dedb-66c1-4a20-9453-adb451d8cd3a Apr 25 15:50:49 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-a76c70bc-97fc-49b4-8b86-b1886f1c0d45 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Create snapshot completed successfully Apr 25 15:50:49 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Creating offline snapshot 9cb33fcf-08ff-47e1-a53f-6c57dacaeda1 of volume 62cc2b67-9252-4f7b-afe5-b1d943e2f4fe {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 15:50:49 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee70643-8c16-4384-acd9-99c500e3d47e]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:50:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:50 devstack sudo[86082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe Apr 25 15:50:50 devstack sudo[86082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:50 devstack sudo[86082]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe" returned: 0 in 0.741s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe.9cb33fcf-08ff-47e1-a53f-6c57dacaeda1 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:50 devstack sudo[86107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe.9cb33fcf-08ff-47e1-a53f-6c57dacaeda1 1G Apr 25 15:50:50 devstack sudo[86107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:50 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d1b0e8e0-feb2-43e8-a98e-393cd4c49654 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Acquiring lock "cinder-f001c79d-7fd9-410d-a908-c79c8373f183-delete_snapshot" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:50:50 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d1b0e8e0-feb2-43e8-a98e-393cd4c49654 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Lock "cinder-f001c79d-7fd9-410d-a908-c79c8373f183-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:50:50 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d1b0e8e0-feb2-43e8-a98e-393cd4c49654 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Acquiring lock "cinder-quobyte-eb652f62-a6e4-44b6-8d87-61fb6858d7e9" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:50:50 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d1b0e8e0-feb2-43e8-a98e-393cd4c49654 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Lock "cinder-quobyte-eb652f62-a6e4-44b6-8d87-61fb6858d7e9" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:50:50 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d1b0e8e0-feb2-43e8-a98e-393cd4c49654 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Acquiring lock "cinder-quobyte-f001c79d-7fd9-410d-a908-c79c8373f183" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:50:50 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d1b0e8e0-feb2-43e8-a98e-393cd4c49654 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Lock "cinder-quobyte-f001c79d-7fd9-410d-a908-c79c8373f183" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:50:50 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-d1b0e8e0-feb2-43e8-a98e-393cd4c49654 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Deleting offline snapshot f001c79d-7fd9-410d-a908-c79c8373f183 of volume eb652f62-a6e4-44b6-8d87-61fb6858d7e9 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 15:50:50 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-d1b0e8e0-feb2-43e8-a98e-393cd4c49654 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] snapshot_file for this snap is: volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9.f001c79d-7fd9-410d-a908-c79c8373f183 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 15:50:50 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8c92aa-5ab9-40b2-9c16-8c1a07202c5a]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:50:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d1b0e8e0-feb2-43e8-a98e-393cd4c49654 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9.f001c79d-7fd9-410d-a908-c79c8373f183 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:51 devstack sudo[86116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9.f001c79d-7fd9-410d-a908-c79c8373f183 Apr 25 15:50:51 devstack sudo[86116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:51 devstack sudo[86107]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe.9cb33fcf-08ff-47e1-a53f-6c57dacaeda1 1G" returned: 0 in 0.713s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe.9cb33fcf-08ff-47e1-a53f-6c57dacaeda1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:51 devstack sudo[86126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe.9cb33fcf-08ff-47e1-a53f-6c57dacaeda1 Apr 25 15:50:51 devstack sudo[86126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:51 devstack sudo[86116]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d1b0e8e0-feb2-43e8-a98e-393cd4c49654 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9.f001c79d-7fd9-410d-a908-c79c8373f183" returned: 0 in 0.534s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:51 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-d1b0e8e0-feb2-43e8-a98e-393cd4c49654 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:50:51 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[87bf33f8-4dd1-4d27-9769-71ff08457e86]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:50:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d1b0e8e0-feb2-43e8-a98e-393cd4c49654 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:51 devstack sudo[86128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9 Apr 25 15:50:51 devstack sudo[86128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:51 devstack sudo[86126]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe.9cb33fcf-08ff-47e1-a53f-6c57dacaeda1" returned: 0 in 0.564s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:51 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe.9cb33fcf-08ff-47e1-a53f-6c57dacaeda1 is being set with open permissions: ugo+rw Apr 25 15:50:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe.9cb33fcf-08ff-47e1-a53f-6c57dacaeda1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:51 devstack sudo[86134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe.9cb33fcf-08ff-47e1-a53f-6c57dacaeda1 Apr 25 15:50:51 devstack sudo[86134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:52 devstack sudo[86128]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d1b0e8e0-feb2-43e8-a98e-393cd4c49654 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9" returned: 0 in 0.687s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d1b0e8e0-feb2-43e8-a98e-393cd4c49654 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9.f001c79d-7fd9-410d-a908-c79c8373f183 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:52 devstack sudo[86140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9.f001c79d-7fd9-410d-a908-c79c8373f183 Apr 25 15:50:52 devstack sudo[86140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:52 devstack sudo[86134]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe.9cb33fcf-08ff-47e1-a53f-6c57dacaeda1" returned: 0 in 0.478s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:52 devstack sudo[86143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe.info Apr 25 15:50:52 devstack sudo[86143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:52 devstack sudo[86140]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d1b0e8e0-feb2-43e8-a98e-393cd4c49654 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9.f001c79d-7fd9-410d-a908-c79c8373f183" returned: 0 in 0.531s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d1b0e8e0-feb2-43e8-a98e-393cd4c49654 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9.f001c79d-7fd9-410d-a908-c79c8373f183 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:52 devstack sudo[86148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9.f001c79d-7fd9-410d-a908-c79c8373f183 Apr 25 15:50:52 devstack sudo[86148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:52 devstack sudo[86143]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe.info" returned: 0 in 0.517s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:52 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe.info is being set with open permissions: ugo+rw Apr 25 15:50:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:53 devstack sudo[86152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe.info Apr 25 15:50:53 devstack sudo[86152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:53 devstack cinder-volume[81828]: INFO cinder.volume.manager [req-10578abf-3e72-447b-ae18-812445757b6a req-8f3ef92a-d7da-4b66-b8a2-05accfde466b tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Terminate volume connection completed successfully. Apr 25 15:50:53 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-10578abf-3e72-447b-ae18-812445757b6a req-8f3ef92a-d7da-4b66-b8a2-05accfde466b tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Deleting attachment 15a9bc27-40bf-40dc-bd36-7ef020b3234d. {{(pid=81828) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 25 15:50:53 devstack sudo[86148]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d1b0e8e0-feb2-43e8-a98e-393cd4c49654 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9.f001c79d-7fd9-410d-a908-c79c8373f183" returned: 0 in 0.516s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:53 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d1b0e8e0-feb2-43e8-a98e-393cd4c49654 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Lock "cinder-quobyte-f001c79d-7fd9-410d-a908-c79c8373f183" released by "_delete_snapshot" :: held 2.378s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:50:53 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d1b0e8e0-feb2-43e8-a98e-393cd4c49654 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Lock "cinder-quobyte-eb652f62-a6e4-44b6-8d87-61fb6858d7e9" released by "delete_snapshot" :: held 2.409s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:50:53 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-d1b0e8e0-feb2-43e8-a98e-393cd4c49654 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Created reservations ['7c4c836c-0f3c-45ea-a75d-e929db30f02a', '88f5710c-6830-423e-b3e6-f6531774e035', '7ec9c0cc-1aa1-4f4e-9ebc-450f11928005', 'f503ade7-6565-4827-b2f3-a966f353f986'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:50:53 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-d1b0e8e0-feb2-43e8-a98e-393cd4c49654 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Delete snapshot completed successfully. Apr 25 15:50:53 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d1b0e8e0-feb2-43e8-a98e-393cd4c49654 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Lock "cinder-f001c79d-7fd9-410d-a908-c79c8373f183-delete_snapshot" released by "delete_snapshot" :: held 2.539s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:50:53 devstack sudo[86152]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe.info" returned: 0 in 0.477s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:53 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Acquiring lock "cinder-quobyte-6b12dedb-66c1-4a20-9453-adb451d8cd3a" by "_copy_volume_from_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:50:53 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Lock "cinder-quobyte-6b12dedb-66c1-4a20-9453-adb451d8cd3a" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:50:53 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] snapshot: 9cb33fcf-08ff-47e1-a53f-6c57dacaeda1, volume: 6b12dedb-66c1-4a20-9453-adb451d8cd3a, {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 25 15:50:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:50:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:50:53 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:50:53 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:50:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:50:53 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef88d823-5382-467d-948f-89c1677e42e5]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:50:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe.9cb33fcf-08ff-47e1-a53f-6c57dacaeda1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:53 devstack sudo[86156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe.9cb33fcf-08ff-47e1-a53f-6c57dacaeda1 Apr 25 15:50:53 devstack sudo[86156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:53 devstack cinder-volume[81828]: DEBUG cinder.coordination [req-10578abf-3e72-447b-ae18-812445757b6a req-4ce9a886-afa1-45cd-b9dc-c771c62f73f6 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Acquiring lock "cinder-303cc37b-c821-43ea-bf35-e142bcc73758-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:50:53 devstack cinder-volume[81828]: DEBUG cinder.coordination [req-10578abf-3e72-447b-ae18-812445757b6a req-4ce9a886-afa1-45cd-b9dc-c771c62f73f6 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Lock "cinder-303cc37b-c821-43ea-bf35-e142bcc73758-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:50:53 devstack cinder-volume[81828]: DEBUG cinder.coordination [req-10578abf-3e72-447b-ae18-812445757b6a req-4ce9a886-afa1-45cd-b9dc-c771c62f73f6 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Acquiring lock "cinder-quobyte-303cc37b-c821-43ea-bf35-e142bcc73758" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:50:53 devstack cinder-volume[81828]: DEBUG cinder.coordination [req-10578abf-3e72-447b-ae18-812445757b6a req-4ce9a886-afa1-45cd-b9dc-c771c62f73f6 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Lock "cinder-quobyte-303cc37b-c821-43ea-bf35-e142bcc73758" acquired by "delete_volume" :: waited 0.023s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:50:53 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[4335fdfd-5c75-4723-9d33-e25c18bbe1c4]: (4, 'raw') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:50:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-10578abf-3e72-447b-ae18-812445757b6a req-4ce9a886-afa1-45cd-b9dc-c771c62f73f6 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:54 devstack sudo[86158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758 Apr 25 15:50:54 devstack sudo[86158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:54 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-8f609eb4-d884-45be-a0c6-cf9d546817e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Acquiring lock "cinder-eb652f62-a6e4-44b6-8d87-61fb6858d7e9-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:50:54 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-8f609eb4-d884-45be-a0c6-cf9d546817e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Lock "cinder-eb652f62-a6e4-44b6-8d87-61fb6858d7e9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:50:54 devstack sudo[86156]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe.9cb33fcf-08ff-47e1-a53f-6c57dacaeda1" returned: 0 in 0.614s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:54 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:50:54 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] will copy from snapshot at /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 25 15:50:54 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Creating direct copy from snapshot {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 25 15:50:54 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48d25cc-90d1-4430-bddc-dd944bd2c711]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:50:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:54 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-8f609eb4-d884-45be-a0c6-cf9d546817e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Acquiring lock "cinder-quobyte-eb652f62-a6e4-44b6-8d87-61fb6858d7e9" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:50:54 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-8f609eb4-d884-45be-a0c6-cf9d546817e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Lock "cinder-quobyte-eb652f62-a6e4-44b6-8d87-61fb6858d7e9" acquired by "delete_volume" :: waited 0.029s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:50:54 devstack sudo[86163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe Apr 25 15:50:54 devstack sudo[86163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:54 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9ce398-ea00-44a2-89e5-48ec326db654]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:50:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8f609eb4-d884-45be-a0c6-cf9d546817e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:54 devstack sudo[86165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9 Apr 25 15:50:54 devstack sudo[86165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:54 devstack sudo[86158]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-10578abf-3e72-447b-ae18-812445757b6a req-4ce9a886-afa1-45cd-b9dc-c771c62f73f6 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758" returned: 0 in 0.621s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-10578abf-3e72-447b-ae18-812445757b6a req-4ce9a886-afa1-45cd-b9dc-c771c62f73f6 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:54 devstack sudo[86171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758 Apr 25 15:50:54 devstack sudo[86171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:54 devstack sudo[86163]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe" returned: 0 in 0.533s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:54 devstack cinder-volume[81828]: DEBUG cinder.utils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Path /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6b12dedb-66c1-4a20-9453-adb451d8cd3a not found in is_blk_device check {{(pid=81828) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 25 15:50:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6b12dedb-66c1-4a20-9453-adb451d8cd3a {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:54 devstack sudo[86174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6b12dedb-66c1-4a20-9453-adb451d8cd3a Apr 25 15:50:54 devstack sudo[86174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:54 devstack sudo[86165]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8f609eb4-d884-45be-a0c6-cf9d546817e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9" returned: 0 in 0.602s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8f609eb4-d884-45be-a0c6-cf9d546817e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:54 devstack sudo[86179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9 Apr 25 15:50:54 devstack sudo[86179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:55 devstack sudo[86171]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-10578abf-3e72-447b-ae18-812445757b6a req-4ce9a886-afa1-45cd-b9dc-c771c62f73f6 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758" returned: 1 in 0.596s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-10578abf-3e72-447b-ae18-812445757b6a req-4ce9a886-afa1-45cd-b9dc-c771c62f73f6 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758' failed. Not Retrying. {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 25 15:50:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-10578abf-3e72-447b-ae18-812445757b6a req-4ce9a886-afa1-45cd-b9dc-c771c62f73f6 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:55 devstack sudo[86187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758 Apr 25 15:50:55 devstack sudo[86187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:55 devstack sudo[86179]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8f609eb4-d884-45be-a0c6-cf9d546817e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eb652f62-a6e4-44b6-8d87-61fb6858d7e9" returned: 0 in 0.551s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:55 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-8f609eb4-d884-45be-a0c6-cf9d546817e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Lock "cinder-quobyte-eb652f62-a6e4-44b6-8d87-61fb6858d7e9" released by "delete_volume" :: held 1.239s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:50:55 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-8f609eb4-d884-45be-a0c6-cf9d546817e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Created reservations ['bda33d7c-1ebb-4d6e-8b7d-7bb1786f1f8f', 'ba97791a-005a-45db-8aab-ce081f65edab', '03cf6b64-b0a3-4ba6-ab0a-d30503690451', '40d8185e-9349-49d6-aa31-851084928f9d'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:50:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-8f609eb4-d884-45be-a0c6-cf9d546817e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:50:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-8f609eb4-d884-45be-a0c6-cf9d546817e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:50:55 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-8f609eb4-d884-45be-a0c6-cf9d546817e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:50:55 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-8f609eb4-d884-45be-a0c6-cf9d546817e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:50:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-8f609eb4-d884-45be-a0c6-cf9d546817e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:50:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8f609eb4-d884-45be-a0c6-cf9d546817e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:55 devstack sudo[86197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:50:55 devstack sudo[86197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:56 devstack sudo[86187]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-10578abf-3e72-447b-ae18-812445757b6a req-4ce9a886-afa1-45cd-b9dc-c771c62f73f6 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-303cc37b-c821-43ea-bf35-e142bcc73758" returned: 0 in 1.352s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:56 devstack cinder-volume[81828]: DEBUG cinder.coordination [req-10578abf-3e72-447b-ae18-812445757b6a req-4ce9a886-afa1-45cd-b9dc-c771c62f73f6 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Lock "cinder-quobyte-303cc37b-c821-43ea-bf35-e142bcc73758" released by "delete_volume" :: held 2.663s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:50:56 devstack cinder-volume[81828]: DEBUG cinder.quota [req-10578abf-3e72-447b-ae18-812445757b6a req-4ce9a886-afa1-45cd-b9dc-c771c62f73f6 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Created reservations ['6ed47669-820f-4871-84e8-098ffceb4caf', '68be08ed-332b-463e-8a2b-c792acc7c881', 'bfdc58d7-834e-453d-b7a3-9f1b02bf9df3', '958cdb13-95e5-4f7b-9941-4ddc67763827'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:50:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-10578abf-3e72-447b-ae18-812445757b6a req-4ce9a886-afa1-45cd-b9dc-c771c62f73f6 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:50:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-10578abf-3e72-447b-ae18-812445757b6a req-4ce9a886-afa1-45cd-b9dc-c771c62f73f6 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:50:56 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [req-10578abf-3e72-447b-ae18-812445757b6a req-4ce9a886-afa1-45cd-b9dc-c771c62f73f6 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:50:56 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [req-10578abf-3e72-447b-ae18-812445757b6a req-4ce9a886-afa1-45cd-b9dc-c771c62f73f6 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:50:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-10578abf-3e72-447b-ae18-812445757b6a req-4ce9a886-afa1-45cd-b9dc-c771c62f73f6 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:50:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-10578abf-3e72-447b-ae18-812445757b6a req-4ce9a886-afa1-45cd-b9dc-c771c62f73f6 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:50:56 devstack sudo[86201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:50:56 devstack sudo[86201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:50:57 devstack sudo[86197]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8f609eb4-d884-45be-a0c6-cf9d546817e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 1.455s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:57 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-8f609eb4-d884-45be-a0c6-cf9d546817e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:50:57 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-8f609eb4-d884-45be-a0c6-cf9d546817e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Deleted volume successfully. Apr 25 15:50:57 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-8f609eb4-d884-45be-a0c6-cf9d546817e3 tempest-VolumeSnapshotQuotasNegativeTestJSON-15088194 None] Lock "cinder-eb652f62-a6e4-44b6-8d87-61fb6858d7e9-delete_volume" released by "delete_volume" :: held 3.125s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:50:58 devstack sudo[86201]: pam_unix(sudo:session): session closed for user root Apr 25 15:50:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-10578abf-3e72-447b-ae18-812445757b6a req-4ce9a886-afa1-45cd-b9dc-c771c62f73f6 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 1.372s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:50:58 devstack cinder-volume[81828]: DEBUG cinder.manager [req-10578abf-3e72-447b-ae18-812445757b6a req-4ce9a886-afa1-45cd-b9dc-c771c62f73f6 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:50:58 devstack cinder-volume[81828]: INFO cinder.volume.manager [req-10578abf-3e72-447b-ae18-812445757b6a req-4ce9a886-afa1-45cd-b9dc-c771c62f73f6 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Deleted volume successfully. Apr 25 15:50:58 devstack cinder-volume[81828]: DEBUG cinder.coordination [req-10578abf-3e72-447b-ae18-812445757b6a req-4ce9a886-afa1-45cd-b9dc-c771c62f73f6 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Lock "cinder-303cc37b-c821-43ea-bf35-e142bcc73758-delete_volume" released by "delete_volume" :: held 4.483s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:51:00 devstack cinder-volume[81828]: DEBUG oslo_service.periodic_task [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81828) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 25 15:51:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:51:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:51:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:00 devstack sudo[86234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:51:00 devstack sudo[86234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:01 devstack sudo[86234]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 1.226s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:01 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:51:01 devstack sudo[86174]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6b12dedb-66c1-4a20-9453-adb451d8cd3a" returned: 0 in 6.880s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:01 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a70fedc-db81-4f45-9b1e-ccda071c1a21]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:51:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:01 devstack sudo[86241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe Apr 25 15:51:01 devstack sudo[86241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:02 devstack sudo[86241]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe" returned: 0 in 0.766s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:02 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Image conversion details: src /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe, size 1024.00 MB, duration 6.88 sec, destination /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6b12dedb-66c1-4a20-9453-adb451d8cd3a {{(pid=81828) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 15:51:02 devstack cinder-volume[81828]: INFO cinder.image.image_utils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Converted 1024.00 MB image at 148.81 MB/s Apr 25 15:51:02 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6b12dedb-66c1-4a20-9453-adb451d8cd3a is being set with open permissions: ugo+rw Apr 25 15:51:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6b12dedb-66c1-4a20-9453-adb451d8cd3a {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:02 devstack sudo[86247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6b12dedb-66c1-4a20-9453-adb451d8cd3a Apr 25 15:51:02 devstack sudo[86247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:02 devstack sudo[86247]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6b12dedb-66c1-4a20-9453-adb451d8cd3a" returned: 0 in 0.526s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:02 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Lock "cinder-quobyte-6b12dedb-66c1-4a20-9453-adb451d8cd3a" released by "_copy_volume_from_snapshot" :: held 9.420s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:51:02 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Acquiring lock "cinder-quobyte-9cb33fcf-08ff-47e1-a53f-6c57dacaeda1" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:51:02 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Lock "cinder-quobyte-9cb33fcf-08ff-47e1-a53f-6c57dacaeda1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:51:02 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Deleting offline snapshot 9cb33fcf-08ff-47e1-a53f-6c57dacaeda1 of volume 62cc2b67-9252-4f7b-afe5-b1d943e2f4fe {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 15:51:02 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] snapshot_file for this snap is: volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe.9cb33fcf-08ff-47e1-a53f-6c57dacaeda1 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 15:51:03 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbdae4a-1af2-4cb8-8002-5a9e35fde44f]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:51:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe.9cb33fcf-08ff-47e1-a53f-6c57dacaeda1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:03 devstack sudo[86250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe.9cb33fcf-08ff-47e1-a53f-6c57dacaeda1 Apr 25 15:51:03 devstack sudo[86250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:03 devstack sudo[86250]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe.9cb33fcf-08ff-47e1-a53f-6c57dacaeda1" returned: 0 in 0.557s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:03 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:51:03 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[48675c8c-bf4d-4219-bf9e-9dda3cf11372]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:51:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:03 devstack sudo[86255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe Apr 25 15:51:03 devstack sudo[86255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:04 devstack sudo[86255]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe" returned: 0 in 0.582s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe.9cb33fcf-08ff-47e1-a53f-6c57dacaeda1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:04 devstack sudo[86261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe.9cb33fcf-08ff-47e1-a53f-6c57dacaeda1 Apr 25 15:51:04 devstack sudo[86261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:04 devstack sudo[86261]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe.9cb33fcf-08ff-47e1-a53f-6c57dacaeda1" returned: 0 in 0.578s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe.9cb33fcf-08ff-47e1-a53f-6c57dacaeda1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:04 devstack sudo[86266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe.9cb33fcf-08ff-47e1-a53f-6c57dacaeda1 Apr 25 15:51:04 devstack sudo[86266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:05 devstack sudo[86266]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe.9cb33fcf-08ff-47e1-a53f-6c57dacaeda1" returned: 0 in 0.528s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:05 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Lock "cinder-quobyte-9cb33fcf-08ff-47e1-a53f-6c57dacaeda1" released by "_delete_snapshot" :: held 2.375s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:51:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.494s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.683s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:05 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1812329112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbe3b2ed-f34d-4fc4-9cb1-f91647f42634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4163408d2424e0895322c7db79f2bac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:50:49Z,use_quota=True,user_id='53545a77f6fd44ceb986aff5580adb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:51:05 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] Creating volume fbe3b2ed-f34d-4fc4-9cb1-f91647f42634 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:51:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:05 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:51:05 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:51:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:05 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:51:05 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:51:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fbe3b2ed-f34d-4fc4-9cb1-f91647f42634 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af159c92-2848-44b4-8d60-464b3510c253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b12dedb-66c1-4a20-9453-adb451d8cd3a', 'volume_size': 2, 'source_volid': '62cc2b67-9252-4f7b-afe5-b1d943e2f4fe', 'source_volstatus': 'available'}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92784bdf-995c-40fc-b05a-b6f9ec86ec30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:05 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Volume volume-6b12dedb-66c1-4a20-9453-adb451d8cd3a (6b12dedb-66c1-4a20-9453-adb451d8cd3a): created successfully Apr 25 15:51:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92784bdf-995c-40fc-b05a-b6f9ec86ec30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Flow 'volume_create_manager' (60e01048-b43e-43df-89ff-ced75d8d1b17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:51:05 devstack sudo[86270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fbe3b2ed-f34d-4fc4-9cb1-f91647f42634 1073741824 Apr 25 15:51:05 devstack sudo[86270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:05 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-b4293cf2-9ae7-46d3-a0e1-b80ea0cbe7ca tempest-VolumesCloneTest-1247357815 None] Created volume successfully. Apr 25 15:51:06 devstack sudo[86270]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fbe3b2ed-f34d-4fc4-9cb1-f91647f42634 1073741824" returned: 0 in 0.793s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fbe3b2ed-f34d-4fc4-9cb1-f91647f42634 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:06 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-13b7556a-08e1-4820-9e40-5f73acdd2218 tempest-VolumesCloneTest-1247357815 None] Acquiring lock "cinder-6b12dedb-66c1-4a20-9453-adb451d8cd3a-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:51:06 devstack sudo[86275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fbe3b2ed-f34d-4fc4-9cb1-f91647f42634 Apr 25 15:51:06 devstack sudo[86275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:06 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-13b7556a-08e1-4820-9e40-5f73acdd2218 tempest-VolumesCloneTest-1247357815 None] Lock "cinder-6b12dedb-66c1-4a20-9453-adb451d8cd3a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:51:06 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-13b7556a-08e1-4820-9e40-5f73acdd2218 tempest-VolumesCloneTest-1247357815 None] Acquiring lock "cinder-quobyte-6b12dedb-66c1-4a20-9453-adb451d8cd3a" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:51:06 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-13b7556a-08e1-4820-9e40-5f73acdd2218 tempest-VolumesCloneTest-1247357815 None] Lock "cinder-quobyte-6b12dedb-66c1-4a20-9453-adb451d8cd3a" acquired by "delete_volume" :: waited 0.016s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:51:06 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdc0d48-10b4-4b36-8d9c-a820b633581b]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:51:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-13b7556a-08e1-4820-9e40-5f73acdd2218 tempest-VolumesCloneTest-1247357815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6b12dedb-66c1-4a20-9453-adb451d8cd3a {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:06 devstack sudo[86277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6b12dedb-66c1-4a20-9453-adb451d8cd3a Apr 25 15:51:06 devstack sudo[86277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:07 devstack sudo[86275]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fbe3b2ed-f34d-4fc4-9cb1-f91647f42634" returned: 0 in 0.852s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:07 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:51:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:07 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8349862e-8544-455a-a495-07bb31f78bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbe3b2ed-f34d-4fc4-9cb1-f91647f42634', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:07 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92fbe45a-b23f-4e52-9243-d35c8646792a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:07 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] Volume volume-fbe3b2ed-f34d-4fc4-9cb1-f91647f42634 (fbe3b2ed-f34d-4fc4-9cb1-f91647f42634): created successfully Apr 25 15:51:07 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92fbe45a-b23f-4e52-9243-d35c8646792a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:07 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] Flow 'volume_create_manager' (35b764b5-3976-49d1-bac6-47199a6b39f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:51:07 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-9b887b6b-644d-4978-a7f6-ef975efd1f58 tempest-VolumeQuotasAdminTestJSON-851585472 None] Created volume successfully. Apr 25 15:51:07 devstack sudo[86277]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-13b7556a-08e1-4820-9e40-5f73acdd2218 tempest-VolumesCloneTest-1247357815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6b12dedb-66c1-4a20-9453-adb451d8cd3a" returned: 0 in 0.867s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-13b7556a-08e1-4820-9e40-5f73acdd2218 tempest-VolumesCloneTest-1247357815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6b12dedb-66c1-4a20-9453-adb451d8cd3a {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:07 devstack sudo[86313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6b12dedb-66c1-4a20-9453-adb451d8cd3a Apr 25 15:51:07 devstack sudo[86313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:07 devstack sudo[86313]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-13b7556a-08e1-4820-9e40-5f73acdd2218 tempest-VolumesCloneTest-1247357815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6b12dedb-66c1-4a20-9453-adb451d8cd3a" returned: 0 in 0.663s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:07 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-13b7556a-08e1-4820-9e40-5f73acdd2218 tempest-VolumesCloneTest-1247357815 None] Lock "cinder-quobyte-6b12dedb-66c1-4a20-9453-adb451d8cd3a" released by "delete_volume" :: held 1.599s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:51:08 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-13b7556a-08e1-4820-9e40-5f73acdd2218 tempest-VolumesCloneTest-1247357815 None] Created reservations ['25df9181-b96e-489f-b7b3-387c905a8606', '5f8fb9df-146e-4c9c-b8c1-dea180b35d0e', 'e0fda2dd-ba8a-43ce-ba3c-f39310a0391d', '7973506c-5862-4057-a31a-0c7e30237d44'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:51:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-13b7556a-08e1-4820-9e40-5f73acdd2218 tempest-VolumesCloneTest-1247357815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-13b7556a-08e1-4820-9e40-5f73acdd2218 tempest-VolumesCloneTest-1247357815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:08 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-13b7556a-08e1-4820-9e40-5f73acdd2218 tempest-VolumesCloneTest-1247357815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:51:08 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-13b7556a-08e1-4820-9e40-5f73acdd2218 tempest-VolumesCloneTest-1247357815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:51:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-13b7556a-08e1-4820-9e40-5f73acdd2218 tempest-VolumesCloneTest-1247357815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-13b7556a-08e1-4820-9e40-5f73acdd2218 tempest-VolumesCloneTest-1247357815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:08 devstack sudo[86319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:51:08 devstack sudo[86319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:08 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-b282794f-f03f-431c-b26c-9ffb4586c788 tempest-VolumeQuotasAdminTestJSON-363569338 None] Transfer volume completed successfully. Apr 25 15:51:08 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3bd422d8-baa0-4544-89d1-107d406f04db tempest-VolumesCloneTest-1247357815 None] Acquiring lock "cinder-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:51:08 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3bd422d8-baa0-4544-89d1-107d406f04db tempest-VolumesCloneTest-1247357815 None] Lock "cinder-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:51:08 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3bd422d8-baa0-4544-89d1-107d406f04db tempest-VolumesCloneTest-1247357815 None] Acquiring lock "cinder-quobyte-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:51:08 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3bd422d8-baa0-4544-89d1-107d406f04db tempest-VolumesCloneTest-1247357815 None] Lock "cinder-quobyte-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe" acquired by "delete_volume" :: waited 0.016s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:51:08 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c630b1a-9db8-4848-855f-5209c3d97811]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:51:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3bd422d8-baa0-4544-89d1-107d406f04db tempest-VolumesCloneTest-1247357815 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:08 devstack sudo[86319]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-13b7556a-08e1-4820-9e40-5f73acdd2218 tempest-VolumesCloneTest-1247357815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.783s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:08 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-13b7556a-08e1-4820-9e40-5f73acdd2218 tempest-VolumesCloneTest-1247357815 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:51:08 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-13b7556a-08e1-4820-9e40-5f73acdd2218 tempest-VolumesCloneTest-1247357815 None] Deleted volume successfully. Apr 25 15:51:08 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-13b7556a-08e1-4820-9e40-5f73acdd2218 tempest-VolumesCloneTest-1247357815 None] Lock "cinder-6b12dedb-66c1-4a20-9453-adb451d8cd3a-delete_volume" released by "delete_volume" :: held 2.623s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:51:08 devstack sudo[86322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe Apr 25 15:51:08 devstack sudo[86322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:09 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5451ff05-5149-4215-bc6d-d7d37227bcbc tempest-VolumeQuotasAdminTestJSON-210771987 None] Acquiring lock "cinder-fbe3b2ed-f34d-4fc4-9cb1-f91647f42634-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:51:09 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5451ff05-5149-4215-bc6d-d7d37227bcbc tempest-VolumeQuotasAdminTestJSON-210771987 None] Lock "cinder-fbe3b2ed-f34d-4fc4-9cb1-f91647f42634-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:51:09 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5451ff05-5149-4215-bc6d-d7d37227bcbc tempest-VolumeQuotasAdminTestJSON-210771987 None] Acquiring lock "cinder-quobyte-fbe3b2ed-f34d-4fc4-9cb1-f91647f42634" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:51:09 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5451ff05-5149-4215-bc6d-d7d37227bcbc tempest-VolumeQuotasAdminTestJSON-210771987 None] Lock "cinder-quobyte-fbe3b2ed-f34d-4fc4-9cb1-f91647f42634" acquired by "delete_volume" :: waited 0.022s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:51:09 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e55b863-d7f8-4558-a07e-48c0da2d2c03]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:51:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5451ff05-5149-4215-bc6d-d7d37227bcbc tempest-VolumeQuotasAdminTestJSON-210771987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fbe3b2ed-f34d-4fc4-9cb1-f91647f42634 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:09 devstack sudo[86328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fbe3b2ed-f34d-4fc4-9cb1-f91647f42634 Apr 25 15:51:09 devstack sudo[86328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:09 devstack sudo[86322]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3bd422d8-baa0-4544-89d1-107d406f04db tempest-VolumesCloneTest-1247357815 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe" returned: 0 in 0.790s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3bd422d8-baa0-4544-89d1-107d406f04db tempest-VolumesCloneTest-1247357815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:09 devstack sudo[86343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe Apr 25 15:51:09 devstack sudo[86343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:09 devstack cinder-volume[81828]: INFO cinder.volume.manager [req-8a32349a-6d45-4720-b296-543e10e032ea req-9cb8b305-b142-4b72-b829-53aa9e80f32a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Terminate volume connection completed successfully. Apr 25 15:51:09 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [req-8a32349a-6d45-4720-b296-543e10e032ea req-9cb8b305-b142-4b72-b829-53aa9e80f32a tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Deleting attachment 67fecaa3-6244-4c01-9de9-72fe208a3065. {{(pid=81828) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 25 15:51:10 devstack sudo[86328]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5451ff05-5149-4215-bc6d-d7d37227bcbc tempest-VolumeQuotasAdminTestJSON-210771987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fbe3b2ed-f34d-4fc4-9cb1-f91647f42634" returned: 0 in 0.694s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5451ff05-5149-4215-bc6d-d7d37227bcbc tempest-VolumeQuotasAdminTestJSON-210771987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fbe3b2ed-f34d-4fc4-9cb1-f91647f42634 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:10 devstack sudo[86343]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3bd422d8-baa0-4544-89d1-107d406f04db tempest-VolumesCloneTest-1247357815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe" returned: 0 in 0.576s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:10 devstack sudo[86371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fbe3b2ed-f34d-4fc4-9cb1-f91647f42634 Apr 25 15:51:10 devstack sudo[86371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:10 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3bd422d8-baa0-4544-89d1-107d406f04db tempest-VolumesCloneTest-1247357815 None] Lock "cinder-quobyte-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe" released by "delete_volume" :: held 1.441s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:51:10 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-3bd422d8-baa0-4544-89d1-107d406f04db tempest-VolumesCloneTest-1247357815 None] Created reservations ['8dba79ce-b7b2-474c-a301-abde257414ac', 'bc248789-edb2-4f3f-be6f-a86494885177', '5b69547e-59ec-4bf6-bfe0-fa89f78e59ea', 'da4b248c-1da4-4cdd-ae17-fcd7e583998a'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:51:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3bd422d8-baa0-4544-89d1-107d406f04db tempest-VolumesCloneTest-1247357815 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3bd422d8-baa0-4544-89d1-107d406f04db tempest-VolumesCloneTest-1247357815 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:10 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3bd422d8-baa0-4544-89d1-107d406f04db tempest-VolumesCloneTest-1247357815 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:51:10 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3bd422d8-baa0-4544-89d1-107d406f04db tempest-VolumesCloneTest-1247357815 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:51:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3bd422d8-baa0-4544-89d1-107d406f04db tempest-VolumesCloneTest-1247357815 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3bd422d8-baa0-4544-89d1-107d406f04db tempest-VolumesCloneTest-1247357815 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:10 devstack sudo[86373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:51:10 devstack sudo[86373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:10 devstack cinder-volume[81828]: DEBUG cinder.coordination [req-8a32349a-6d45-4720-b296-543e10e032ea req-f395c15e-dbed-4eca-bc35-ae98f013e4b9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Acquiring lock "cinder-3cee2317-3b94-469a-91ad-b66c355cb3b8-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:51:10 devstack cinder-volume[81828]: DEBUG cinder.coordination [req-8a32349a-6d45-4720-b296-543e10e032ea req-f395c15e-dbed-4eca-bc35-ae98f013e4b9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Lock "cinder-3cee2317-3b94-469a-91ad-b66c355cb3b8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:51:10 devstack cinder-volume[81828]: DEBUG cinder.coordination [req-8a32349a-6d45-4720-b296-543e10e032ea req-f395c15e-dbed-4eca-bc35-ae98f013e4b9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Acquiring lock "cinder-quobyte-3cee2317-3b94-469a-91ad-b66c355cb3b8" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:51:10 devstack cinder-volume[81828]: DEBUG cinder.coordination [req-8a32349a-6d45-4720-b296-543e10e032ea req-f395c15e-dbed-4eca-bc35-ae98f013e4b9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Lock "cinder-quobyte-3cee2317-3b94-469a-91ad-b66c355cb3b8" acquired by "delete_volume" :: waited 0.016s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:51:10 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6daba03-b532-4698-a416-da068a7ac4fc]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:51:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-8a32349a-6d45-4720-b296-543e10e032ea req-f395c15e-dbed-4eca-bc35-ae98f013e4b9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3cee2317-3b94-469a-91ad-b66c355cb3b8 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:10 devstack sudo[86371]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5451ff05-5149-4215-bc6d-d7d37227bcbc tempest-VolumeQuotasAdminTestJSON-210771987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fbe3b2ed-f34d-4fc4-9cb1-f91647f42634" returned: 0 in 0.700s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:10 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5451ff05-5149-4215-bc6d-d7d37227bcbc tempest-VolumeQuotasAdminTestJSON-210771987 None] Lock "cinder-quobyte-fbe3b2ed-f34d-4fc4-9cb1-f91647f42634" released by "delete_volume" :: held 1.441s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:51:10 devstack sudo[86373]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3bd422d8-baa0-4544-89d1-107d406f04db tempest-VolumesCloneTest-1247357815 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.601s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:10 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-3bd422d8-baa0-4544-89d1-107d406f04db tempest-VolumesCloneTest-1247357815 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:51:10 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-3bd422d8-baa0-4544-89d1-107d406f04db tempest-VolumesCloneTest-1247357815 None] Deleted volume successfully. Apr 25 15:51:10 devstack sudo[86377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3cee2317-3b94-469a-91ad-b66c355cb3b8 Apr 25 15:51:10 devstack sudo[86377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:10 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3bd422d8-baa0-4544-89d1-107d406f04db tempest-VolumesCloneTest-1247357815 None] Lock "cinder-62cc2b67-9252-4f7b-afe5-b1d943e2f4fe-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:51:10 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-5451ff05-5149-4215-bc6d-d7d37227bcbc tempest-VolumeQuotasAdminTestJSON-210771987 None] Created reservations ['e5f22e81-34f4-4317-8b17-703de2b56b03', '1ae5cd7c-6b7b-444c-a2d7-8f81ec8b2a7e', '49036603-0016-4538-a522-5117a7149c90', '50742bf6-fada-4f7b-a237-8d87b8980577'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:51:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-5451ff05-5149-4215-bc6d-d7d37227bcbc tempest-VolumeQuotasAdminTestJSON-210771987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-5451ff05-5149-4215-bc6d-d7d37227bcbc tempest-VolumeQuotasAdminTestJSON-210771987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:11 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-5451ff05-5149-4215-bc6d-d7d37227bcbc tempest-VolumeQuotasAdminTestJSON-210771987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:51:11 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-5451ff05-5149-4215-bc6d-d7d37227bcbc tempest-VolumeQuotasAdminTestJSON-210771987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:51:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-5451ff05-5149-4215-bc6d-d7d37227bcbc tempest-VolumeQuotasAdminTestJSON-210771987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5451ff05-5149-4215-bc6d-d7d37227bcbc tempest-VolumeQuotasAdminTestJSON-210771987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:11 devstack sudo[86379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:51:11 devstack sudo[86379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:11 devstack sudo[86377]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-8a32349a-6d45-4720-b296-543e10e032ea req-f395c15e-dbed-4eca-bc35-ae98f013e4b9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3cee2317-3b94-469a-91ad-b66c355cb3b8" returned: 0 in 0.845s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-8a32349a-6d45-4720-b296-543e10e032ea req-f395c15e-dbed-4eca-bc35-ae98f013e4b9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3cee2317-3b94-469a-91ad-b66c355cb3b8 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:11 devstack sudo[86386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3cee2317-3b94-469a-91ad-b66c355cb3b8 Apr 25 15:51:11 devstack sudo[86379]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:11 devstack sudo[86386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5451ff05-5149-4215-bc6d-d7d37227bcbc tempest-VolumeQuotasAdminTestJSON-210771987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.659s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:11 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-5451ff05-5149-4215-bc6d-d7d37227bcbc tempest-VolumeQuotasAdminTestJSON-210771987 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:51:11 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-5451ff05-5149-4215-bc6d-d7d37227bcbc tempest-VolumeQuotasAdminTestJSON-210771987 None] Deleted volume successfully. Apr 25 15:51:11 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5451ff05-5149-4215-bc6d-d7d37227bcbc tempest-VolumeQuotasAdminTestJSON-210771987 None] Lock "cinder-fbe3b2ed-f34d-4fc4-9cb1-f91647f42634-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:51:12 devstack sudo[86386]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-8a32349a-6d45-4720-b296-543e10e032ea req-f395c15e-dbed-4eca-bc35-ae98f013e4b9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3cee2317-3b94-469a-91ad-b66c355cb3b8" returned: 0 in 0.759s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:12 devstack cinder-volume[81828]: DEBUG cinder.coordination [req-8a32349a-6d45-4720-b296-543e10e032ea req-f395c15e-dbed-4eca-bc35-ae98f013e4b9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Lock "cinder-quobyte-3cee2317-3b94-469a-91ad-b66c355cb3b8" released by "delete_volume" :: held 1.651s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:51:12 devstack cinder-volume[81828]: DEBUG cinder.quota [req-8a32349a-6d45-4720-b296-543e10e032ea req-f395c15e-dbed-4eca-bc35-ae98f013e4b9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Created reservations ['12a2ab26-c970-4462-80b6-1970c78c367c', 'fab4c572-4f04-4dfa-abbd-732fb6dc2bf8', 'fda9eeff-55ff-48b1-b917-7dcea75a35a5', 'd7e7bef8-0009-4dca-9432-a7b4fe950a85'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:51:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-8a32349a-6d45-4720-b296-543e10e032ea req-f395c15e-dbed-4eca-bc35-ae98f013e4b9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-8a32349a-6d45-4720-b296-543e10e032ea req-f395c15e-dbed-4eca-bc35-ae98f013e4b9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:12 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [req-8a32349a-6d45-4720-b296-543e10e032ea req-f395c15e-dbed-4eca-bc35-ae98f013e4b9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:51:12 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [req-8a32349a-6d45-4720-b296-543e10e032ea req-f395c15e-dbed-4eca-bc35-ae98f013e4b9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:51:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [req-8a32349a-6d45-4720-b296-543e10e032ea req-f395c15e-dbed-4eca-bc35-ae98f013e4b9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-8a32349a-6d45-4720-b296-543e10e032ea req-f395c15e-dbed-4eca-bc35-ae98f013e4b9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:12 devstack sudo[86389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:51:12 devstack sudo[86389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:13 devstack sudo[86389]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [req-8a32349a-6d45-4720-b296-543e10e032ea req-f395c15e-dbed-4eca-bc35-ae98f013e4b9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.617s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:13 devstack cinder-volume[81828]: DEBUG cinder.manager [req-8a32349a-6d45-4720-b296-543e10e032ea req-f395c15e-dbed-4eca-bc35-ae98f013e4b9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:51:13 devstack cinder-volume[81828]: INFO cinder.volume.manager [req-8a32349a-6d45-4720-b296-543e10e032ea req-f395c15e-dbed-4eca-bc35-ae98f013e4b9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Deleted volume successfully. Apr 25 15:51:13 devstack cinder-volume[81828]: DEBUG cinder.coordination [req-8a32349a-6d45-4720-b296-543e10e032ea req-f395c15e-dbed-4eca-bc35-ae98f013e4b9 tempest-ServerBootFromVolumeStableRescueTest-1304828384 None] Lock "cinder-3cee2317-3b94-469a-91ad-b66c355cb3b8-delete_volume" released by "delete_volume" :: held 2.603s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:51:14 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:51:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] Flow 'volume_create_manager' (add3b5f1-1f27-4352-bcde-6836c8dadd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:51:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72bb2529-78cc-44bc-afa2-d3a1454da561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72bb2529-78cc-44bc-afa2-d3a1454da561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-859653805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c32a2ed-eb23-4e94-8b5b-a455f39bda4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6086b682027045a3ae491a200a58c3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:15Z,use_quota=True,user_id='44f434813aec4e39847a91fb4d9519d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2755fadf-9024-42d0-b311-5e5597bbd475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2755fadf-9024-42d0-b311-5e5597bbd475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20043c95-6d41-453f-8018-c5f38cbe7a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20043c95-6d41-453f-8018-c5f38cbe7a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c32a2ed-eb23-4e94-8b5b-a455f39bda4e', 'volume_name': 'volume-2c32a2ed-eb23-4e94-8b5b-a455f39bda4e', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e7ef1ea-20a1-47d4-b0e6-042d2e5c71b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e7ef1ea-20a1-47d4-b0e6-042d2e5c71b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3338aac8-7c5d-42d1-9f25-9fed5dbd6bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:14 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] Volume 2c32a2ed-eb23-4e94-8b5b-a455f39bda4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c32a2ed-eb23-4e94-8b5b-a455f39bda4e', 'volume_size': 1} Apr 25 15:51:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:14 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-859653805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c32a2ed-eb23-4e94-8b5b-a455f39bda4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6086b682027045a3ae491a200a58c3a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:15Z,use_quota=True,user_id='44f434813aec4e39847a91fb4d9519d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:51:14 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] Creating volume 2c32a2ed-eb23-4e94-8b5b-a455f39bda4e {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:51:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:14 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:51:14 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:51:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:14 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:51:14 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:51:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2c32a2ed-eb23-4e94-8b5b-a455f39bda4e 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:14 devstack sudo[86402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2c32a2ed-eb23-4e94-8b5b-a455f39bda4e 1073741824 Apr 25 15:51:14 devstack sudo[86402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:16 devstack sudo[86402]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2c32a2ed-eb23-4e94-8b5b-a455f39bda4e 1073741824" returned: 0 in 1.109s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2c32a2ed-eb23-4e94-8b5b-a455f39bda4e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:16 devstack sudo[86432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2c32a2ed-eb23-4e94-8b5b-a455f39bda4e Apr 25 15:51:16 devstack sudo[86432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:16 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:SELECT=90,cinder:INSERT=31,cinder:UPDATE=121,cinder:DELETE=13 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:51:16 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:51:16 devstack sudo[86432]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] Flow 'volume_create_manager' (2f05cc34-432f-469b-b0b1-d9b51d8a746e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:51:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad3f24c-f641-4824-b5ee-5c833045493a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad3f24c-f641-4824-b5ee-5c833045493a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1003453942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c55a39-4267-4176-85f9-b040c9280667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53fcb3ef34c24f22ac3ba16b87a70f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:17Z,use_quota=True,user_id='e89e03331042428098e3a19eeb9ef8bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (387cfbb0-adf5-45e7-b1ed-560d5d583132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (387cfbb0-adf5-45e7-b1ed-560d5d583132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84a39e04-b7b0-4e81-a2e5-bb092537e3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84a39e04-b7b0-4e81-a2e5-bb092537e3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72c55a39-4267-4176-85f9-b040c9280667', 'volume_name': 'volume-72c55a39-4267-4176-85f9-b040c9280667', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ffa03f-0aef-41ad-8b99-c5b613f7b82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ffa03f-0aef-41ad-8b99-c5b613f7b82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb659778-6662-4fe3-bad6-e0039c885817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:16 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] Volume 72c55a39-4267-4176-85f9-b040c9280667: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72c55a39-4267-4176-85f9-b040c9280667', 'volume_size': 1} Apr 25 15:51:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2c32a2ed-eb23-4e94-8b5b-a455f39bda4e" returned: 0 in 0.920s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] <== create_volume: return (2115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:51:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.118s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.014s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1003453942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72c55a39-4267-4176-85f9-b040c9280667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53fcb3ef34c24f22ac3ba16b87a70f22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:17Z,use_quota=True,user_id='e89e03331042428098e3a19eeb9ef8bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:51:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] Creating volume 72c55a39-4267-4176-85f9-b040c9280667 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:51:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:51:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:51:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:51:16 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:51:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72c55a39-4267-4176-85f9-b040c9280667 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:17 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3338aac8-7c5d-42d1-9f25-9fed5dbd6bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c32a2ed-eb23-4e94-8b5b-a455f39bda4e', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:17 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f4e45f-e168-49d3-b7c6-14b24096704a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:17 devstack sudo[86436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72c55a39-4267-4176-85f9-b040c9280667 1073741824 Apr 25 15:51:17 devstack sudo[86436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:17 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] Volume volume-2c32a2ed-eb23-4e94-8b5b-a455f39bda4e (2c32a2ed-eb23-4e94-8b5b-a455f39bda4e): created successfully Apr 25 15:51:17 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73f4e45f-e168-49d3-b7c6-14b24096704a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:17 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] Flow 'volume_create_manager' (add3b5f1-1f27-4352-bcde-6836c8dadd35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:51:17 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-05d6c2c6-ae87-485f-af7e-6b5770aebd29 tempest-VolumesNegativeTest-1933649986 None] Created volume successfully. Apr 25 15:51:18 devstack sudo[86436]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72c55a39-4267-4176-85f9-b040c9280667 1073741824" returned: 0 in 1.012s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72c55a39-4267-4176-85f9-b040c9280667 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:18 devstack sudo[86444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72c55a39-4267-4176-85f9-b040c9280667 Apr 25 15:51:18 devstack sudo[86444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:18 devstack sudo[86444]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72c55a39-4267-4176-85f9-b040c9280667" returned: 0 in 0.539s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:18 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:51:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:18 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb659778-6662-4fe3-bad6-e0039c885817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72c55a39-4267-4176-85f9-b040c9280667', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:18 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d550cd3c-b9ac-42a9-9be1-0e08ec8b4f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:18 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] Volume volume-72c55a39-4267-4176-85f9-b040c9280667 (72c55a39-4267-4176-85f9-b040c9280667): created successfully Apr 25 15:51:18 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d550cd3c-b9ac-42a9-9be1-0e08ec8b4f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:18 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] Flow 'volume_create_manager' (2f05cc34-432f-469b-b0b1-d9b51d8a746e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:51:18 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-1f4eb434-8ab6-42d3-9d41-c672a873182a tempest-VolumesMetadataTest-1415360848 None] Created volume successfully. Apr 25 15:51:19 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7e2bdea6-c59b-4628-9b6a-4e3593e1fdaa tempest-VolumesMetadataTest-1415360848 None] Acquiring lock "cinder-72c55a39-4267-4176-85f9-b040c9280667-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:51:19 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7e2bdea6-c59b-4628-9b6a-4e3593e1fdaa tempest-VolumesMetadataTest-1415360848 None] Lock "cinder-72c55a39-4267-4176-85f9-b040c9280667-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:51:19 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7e2bdea6-c59b-4628-9b6a-4e3593e1fdaa tempest-VolumesMetadataTest-1415360848 None] Acquiring lock "cinder-quobyte-72c55a39-4267-4176-85f9-b040c9280667" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:51:19 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7e2bdea6-c59b-4628-9b6a-4e3593e1fdaa tempest-VolumesMetadataTest-1415360848 None] Lock "cinder-quobyte-72c55a39-4267-4176-85f9-b040c9280667" acquired by "delete_volume" :: waited 0.021s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:51:19 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[488a0bee-3cd6-4635-bff5-456b6f6a143a]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:51:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7e2bdea6-c59b-4628-9b6a-4e3593e1fdaa tempest-VolumesMetadataTest-1415360848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72c55a39-4267-4176-85f9-b040c9280667 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:19 devstack sudo[86452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72c55a39-4267-4176-85f9-b040c9280667 Apr 25 15:51:19 devstack sudo[86452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:20 devstack sudo[86452]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7e2bdea6-c59b-4628-9b6a-4e3593e1fdaa tempest-VolumesMetadataTest-1415360848 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72c55a39-4267-4176-85f9-b040c9280667" returned: 0 in 0.647s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7e2bdea6-c59b-4628-9b6a-4e3593e1fdaa tempest-VolumesMetadataTest-1415360848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72c55a39-4267-4176-85f9-b040c9280667 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:20 devstack sudo[86457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72c55a39-4267-4176-85f9-b040c9280667 Apr 25 15:51:20 devstack sudo[86457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:21 devstack sudo[86457]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7e2bdea6-c59b-4628-9b6a-4e3593e1fdaa tempest-VolumesMetadataTest-1415360848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72c55a39-4267-4176-85f9-b040c9280667" returned: 0 in 0.607s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:21 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7e2bdea6-c59b-4628-9b6a-4e3593e1fdaa tempest-VolumesMetadataTest-1415360848 None] Lock "cinder-quobyte-72c55a39-4267-4176-85f9-b040c9280667" released by "delete_volume" :: held 1.303s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:51:21 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-7e2bdea6-c59b-4628-9b6a-4e3593e1fdaa tempest-VolumesMetadataTest-1415360848 None] Created reservations ['81ba51d6-95a9-421d-82cb-8a88fd48309c', '3a1c67f7-92b9-4d14-90a0-011465f72553', '0eadb377-e750-48ea-8aad-79d8aec00f26', 'e3fe4d3b-433f-4e2b-957d-6a0646b60ae5'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:51:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7e2bdea6-c59b-4628-9b6a-4e3593e1fdaa tempest-VolumesMetadataTest-1415360848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7e2bdea6-c59b-4628-9b6a-4e3593e1fdaa tempest-VolumesMetadataTest-1415360848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:21 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-7e2bdea6-c59b-4628-9b6a-4e3593e1fdaa tempest-VolumesMetadataTest-1415360848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:51:21 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-7e2bdea6-c59b-4628-9b6a-4e3593e1fdaa tempest-VolumesMetadataTest-1415360848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:51:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7e2bdea6-c59b-4628-9b6a-4e3593e1fdaa tempest-VolumesMetadataTest-1415360848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7e2bdea6-c59b-4628-9b6a-4e3593e1fdaa tempest-VolumesMetadataTest-1415360848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:21 devstack sudo[86461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:51:21 devstack sudo[86461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:21 devstack sudo[86461]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7e2bdea6-c59b-4628-9b6a-4e3593e1fdaa tempest-VolumesMetadataTest-1415360848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.628s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:21 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-7e2bdea6-c59b-4628-9b6a-4e3593e1fdaa tempest-VolumesMetadataTest-1415360848 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:51:21 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-7e2bdea6-c59b-4628-9b6a-4e3593e1fdaa tempest-VolumesMetadataTest-1415360848 None] Deleted volume successfully. Apr 25 15:51:21 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7e2bdea6-c59b-4628-9b6a-4e3593e1fdaa tempest-VolumesMetadataTest-1415360848 None] Lock "cinder-72c55a39-4267-4176-85f9-b040c9280667-delete_volume" released by "delete_volume" :: held 2.166s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:51:26 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:51:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] Flow 'volume_create_manager' (7587ce7b-2282-4326-9724-6b2b46e97673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:51:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a383adb4-47d0-4b56-b6b5-8fec664907e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:26 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:UPDATE=119,cinder:SELECT=79,cinder:INSERT=27,cinder:DELETE=6 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:51:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a383adb4-47d0-4b56-b6b5-8fec664907e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1401423567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1625ad60-2f4e-42d0-a39d-08f69373a103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74cf1e887056463ba7eced793fbfe4aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:26Z,use_quota=True,user_id='9120ce27d0ae4398bda6df266eb7775e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfefa2a7-ddbf-4b01-8bf5-fb11620765de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfefa2a7-ddbf-4b01-8bf5-fb11620765de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d81216-e24e-4452-acad-28bf36f55479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0d81216-e24e-4452-acad-28bf36f55479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1625ad60-2f4e-42d0-a39d-08f69373a103', 'volume_name': 'volume-1625ad60-2f4e-42d0-a39d-08f69373a103', 'volume_size': 2}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edbd08df-c5f6-4d2a-91eb-c01c893a6e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edbd08df-c5f6-4d2a-91eb-c01c893a6e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e9a74c2-f7ec-4d29-b9d2-fbc92e06fabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:26 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] Volume 1625ad60-2f4e-42d0-a39d-08f69373a103: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1625ad60-2f4e-42d0-a39d-08f69373a103', 'volume_size': 2} Apr 25 15:51:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:26 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1401423567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1625ad60-2f4e-42d0-a39d-08f69373a103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74cf1e887056463ba7eced793fbfe4aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:26Z,use_quota=True,user_id='9120ce27d0ae4398bda6df266eb7775e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:51:26 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] Creating volume 1625ad60-2f4e-42d0-a39d-08f69373a103 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:51:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:26 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:51:26 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:51:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:26 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:51:26 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:51:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1625ad60-2f4e-42d0-a39d-08f69373a103 2147483648 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:26 devstack sudo[86483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1625ad60-2f4e-42d0-a39d-08f69373a103 2147483648 Apr 25 15:51:26 devstack sudo[86483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:27 devstack sudo[86483]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1625ad60-2f4e-42d0-a39d-08f69373a103 2147483648" returned: 0 in 1.032s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1625ad60-2f4e-42d0-a39d-08f69373a103 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:27 devstack sudo[86490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1625ad60-2f4e-42d0-a39d-08f69373a103 Apr 25 15:51:27 devstack sudo[86490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] Flow 'volume_create_manager' (5e6a7a0c-4884-4b34-b164-d23797ef7e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86170fe0-2b1a-419c-a34c-fb078cfbe4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86170fe0-2b1a-419c-a34c-fb078cfbe4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-571277977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e0194db-7d0d-420c-a6b6-b016586c8432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cff119e44ebb473eaaf92eb6ce2b5bbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:28Z,use_quota=True,user_id='b3478420ac3342dd989e53899a1f0e13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (821d8251-e2ed-4c8c-875b-0356618a9760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (821d8251-e2ed-4c8c-875b-0356618a9760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c597fbe1-2145-4791-9ca3-6828cadd21ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c597fbe1-2145-4791-9ca3-6828cadd21ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e0194db-7d0d-420c-a6b6-b016586c8432', 'volume_name': 'volume-1e0194db-7d0d-420c-a6b6-b016586c8432', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51419458-356a-4a15-bf93-f2ff861481e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51419458-356a-4a15-bf93-f2ff861481e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:28 devstack sudo[86490]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (badbee4f-5dd5-4c99-bdee-a3f7a7131364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:28 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] Volume 1e0194db-7d0d-420c-a6b6-b016586c8432: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e0194db-7d0d-420c-a6b6-b016586c8432', 'volume_size': 1} Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1625ad60-2f4e-42d0-a39d-08f69373a103" returned: 0 in 0.689s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-571277977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e0194db-7d0d-420c-a6b6-b016586c8432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cff119e44ebb473eaaf92eb6ce2b5bbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:28Z,use_quota=True,user_id='b3478420ac3342dd989e53899a1f0e13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] Creating volume 1e0194db-7d0d-420c-a6b6-b016586c8432 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:51:28 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1e0194db-7d0d-420c-a6b6-b016586c8432 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e9a74c2-f7ec-4d29-b9d2-fbc92e06fabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1625ad60-2f4e-42d0-a39d-08f69373a103', 'volume_size': 2}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:28 devstack sudo[86493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1e0194db-7d0d-420c-a6b6-b016586c8432 1073741824 Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dbff263-db37-46f1-b5fd-76c06cf9b525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:28 devstack sudo[86493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:28 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] Volume volume-1625ad60-2f4e-42d0-a39d-08f69373a103 (1625ad60-2f4e-42d0-a39d-08f69373a103): created successfully Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dbff263-db37-46f1-b5fd-76c06cf9b525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] Flow 'volume_create_manager' (7587ce7b-2282-4326-9724-6b2b46e97673) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:51:28 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-03482f18-118c-437b-91c0-9a7ab650b381 tempest-VolumesCloneNegativeTest-219756831 None] Created volume successfully. Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-30fbb986-19e0-4acc-8b3c-fd40f37d751f tempest-VolumesCloneNegativeTest-219756831 None] Acquiring lock "cinder-1625ad60-2f4e-42d0-a39d-08f69373a103-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-30fbb986-19e0-4acc-8b3c-fd40f37d751f tempest-VolumesCloneNegativeTest-219756831 None] Lock "cinder-1625ad60-2f4e-42d0-a39d-08f69373a103-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-30fbb986-19e0-4acc-8b3c-fd40f37d751f tempest-VolumesCloneNegativeTest-219756831 None] Acquiring lock "cinder-quobyte-1625ad60-2f4e-42d0-a39d-08f69373a103" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-30fbb986-19e0-4acc-8b3c-fd40f37d751f tempest-VolumesCloneNegativeTest-219756831 None] Lock "cinder-quobyte-1625ad60-2f4e-42d0-a39d-08f69373a103" acquired by "delete_volume" :: waited 0.017s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[879f0ee2-63dd-4493-830c-2f0dbde50e5e]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:51:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-30fbb986-19e0-4acc-8b3c-fd40f37d751f tempest-VolumesCloneNegativeTest-219756831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1625ad60-2f4e-42d0-a39d-08f69373a103 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:28 devstack sudo[86495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1625ad60-2f4e-42d0-a39d-08f69373a103 Apr 25 15:51:28 devstack sudo[86495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:29 devstack sudo[86493]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1e0194db-7d0d-420c-a6b6-b016586c8432 1073741824" returned: 0 in 0.805s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1e0194db-7d0d-420c-a6b6-b016586c8432 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:29 devstack sudo[86500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1e0194db-7d0d-420c-a6b6-b016586c8432 Apr 25 15:51:29 devstack sudo[86500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:29 devstack sudo[86495]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-30fbb986-19e0-4acc-8b3c-fd40f37d751f tempest-VolumesCloneNegativeTest-219756831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1625ad60-2f4e-42d0-a39d-08f69373a103" returned: 0 in 0.729s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-30fbb986-19e0-4acc-8b3c-fd40f37d751f tempest-VolumesCloneNegativeTest-219756831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1625ad60-2f4e-42d0-a39d-08f69373a103 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:29 devstack sudo[86505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1625ad60-2f4e-42d0-a39d-08f69373a103 Apr 25 15:51:29 devstack sudo[86505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:29 devstack sudo[86500]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1e0194db-7d0d-420c-a6b6-b016586c8432" returned: 0 in 0.565s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:29 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:51:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (badbee4f-5dd5-4c99-bdee-a3f7a7131364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e0194db-7d0d-420c-a6b6-b016586c8432', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7abc9db0-0dfa-41cd-944e-62b0533a8150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:29 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] Volume volume-1e0194db-7d0d-420c-a6b6-b016586c8432 (1e0194db-7d0d-420c-a6b6-b016586c8432): created successfully Apr 25 15:51:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7abc9db0-0dfa-41cd-944e-62b0533a8150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] Flow 'volume_create_manager' (5e6a7a0c-4884-4b34-b164-d23797ef7e85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:51:29 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-495654eb-2e14-4083-a32f-0d0e97de7ab0 tempest-VolumesListAdminTestJSON-1609339594 None] Created volume successfully. Apr 25 15:51:30 devstack sudo[86505]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-30fbb986-19e0-4acc-8b3c-fd40f37d751f tempest-VolumesCloneNegativeTest-219756831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1625ad60-2f4e-42d0-a39d-08f69373a103" returned: 0 in 0.513s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-30fbb986-19e0-4acc-8b3c-fd40f37d751f tempest-VolumesCloneNegativeTest-219756831 None] Lock "cinder-quobyte-1625ad60-2f4e-42d0-a39d-08f69373a103" released by "delete_volume" :: held 1.293s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-30fbb986-19e0-4acc-8b3c-fd40f37d751f tempest-VolumesCloneNegativeTest-219756831 None] Created reservations ['6d19f54e-9535-42bf-987a-e0fdcd929b60', '1ccfc95c-905e-4b4e-b5c1-1bc002caf09b', 'cb0b2331-ed78-4b80-868e-6f44e1f68bcc', 'e2b1530b-0f51-4254-bcb5-6707d688a2a3'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-30fbb986-19e0-4acc-8b3c-fd40f37d751f tempest-VolumesCloneNegativeTest-219756831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-30fbb986-19e0-4acc-8b3c-fd40f37d751f tempest-VolumesCloneNegativeTest-219756831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-30fbb986-19e0-4acc-8b3c-fd40f37d751f tempest-VolumesCloneNegativeTest-219756831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-30fbb986-19e0-4acc-8b3c-fd40f37d751f tempest-VolumesCloneNegativeTest-219756831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-30fbb986-19e0-4acc-8b3c-fd40f37d751f tempest-VolumesCloneNegativeTest-219756831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-30fbb986-19e0-4acc-8b3c-fd40f37d751f tempest-VolumesCloneNegativeTest-219756831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:30 devstack sudo[86509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:51:30 devstack sudo[86509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:30 devstack sudo[86509]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-30fbb986-19e0-4acc-8b3c-fd40f37d751f tempest-VolumesCloneNegativeTest-219756831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.557s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-30fbb986-19e0-4acc-8b3c-fd40f37d751f tempest-VolumesCloneNegativeTest-219756831 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:51:30 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-30fbb986-19e0-4acc-8b3c-fd40f37d751f tempest-VolumesCloneNegativeTest-219756831 None] Deleted volume successfully. Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-30fbb986-19e0-4acc-8b3c-fd40f37d751f tempest-VolumesCloneNegativeTest-219756831 None] Lock "cinder-1625ad60-2f4e-42d0-a39d-08f69373a103-delete_volume" released by "delete_volume" :: held 2.053s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] Flow 'volume_create_manager' (e05b9abe-c1a0-4cc0-b08a-55a07bcdf6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a10023d-d4a3-4ce2-88d5-632b34b44497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a10023d-d4a3-4ce2-88d5-632b34b44497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1027958431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00324578-77e6-4493-a83c-5e06a0cf1f9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cff119e44ebb473eaaf92eb6ce2b5bbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:31Z,use_quota=True,user_id='b3478420ac3342dd989e53899a1f0e13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3d96420-962e-4c02-afea-8f760fa63c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3d96420-962e-4c02-afea-8f760fa63c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6746cfc2-8308-49e1-9369-fc3de1bd3911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6746cfc2-8308-49e1-9369-fc3de1bd3911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00324578-77e6-4493-a83c-5e06a0cf1f9e', 'volume_name': 'volume-00324578-77e6-4493-a83c-5e06a0cf1f9e', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f8b373-c320-4bf5-bb37-95866e746f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7f8b373-c320-4bf5-bb37-95866e746f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc4c9bd4-21ef-4a23-947f-ea2e02a7d671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:30 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] Volume 00324578-77e6-4493-a83c-5e06a0cf1f9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00324578-77e6-4493-a83c-5e06a0cf1f9e', 'volume_size': 1} Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1027958431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00324578-77e6-4493-a83c-5e06a0cf1f9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cff119e44ebb473eaaf92eb6ce2b5bbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:31Z,use_quota=True,user_id='b3478420ac3342dd989e53899a1f0e13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] Creating volume 00324578-77e6-4493-a83c-5e06a0cf1f9e {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:51:30 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:51:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-00324578-77e6-4493-a83c-5e06a0cf1f9e 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:30 devstack sudo[86515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-00324578-77e6-4493-a83c-5e06a0cf1f9e 1073741824 Apr 25 15:51:30 devstack sudo[86515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:31 devstack sudo[86515]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-00324578-77e6-4493-a83c-5e06a0cf1f9e 1073741824" returned: 0 in 0.764s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-00324578-77e6-4493-a83c-5e06a0cf1f9e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:31 devstack sudo[86521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-00324578-77e6-4493-a83c-5e06a0cf1f9e Apr 25 15:51:31 devstack sudo[86521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:32 devstack sudo[86521]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-00324578-77e6-4493-a83c-5e06a0cf1f9e" returned: 0 in 0.587s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:32 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:51:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.397s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:32 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc4c9bd4-21ef-4a23-947f-ea2e02a7d671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00324578-77e6-4493-a83c-5e06a0cf1f9e', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:32 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2c62fe7-9636-4c46-9f3a-1b406c0bbc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:32 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] Volume volume-00324578-77e6-4493-a83c-5e06a0cf1f9e (00324578-77e6-4493-a83c-5e06a0cf1f9e): created successfully Apr 25 15:51:32 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2c62fe7-9636-4c46-9f3a-1b406c0bbc75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:32 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] Flow 'volume_create_manager' (e05b9abe-c1a0-4cc0-b08a-55a07bcdf6e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:51:32 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-aa8479e2-ab9c-4f8d-9248-a4a300a16920 tempest-VolumesListAdminTestJSON-1609339594 None] Created volume successfully. Apr 25 15:51:33 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:51:33 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] Flow 'volume_create_manager' (815a2a22-a49b-47ef-9bdc-e96d9c44b10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:51:33 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59be4690-b1d4-47b1-96df-b9a3550ca5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:33 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59be4690-b1d4-47b1-96df-b9a3550ca5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1800664022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d6373d-f33d-4e87-81e8-3633eb99e96f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cff119e44ebb473eaaf92eb6ce2b5bbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:33Z,use_quota=True,user_id='b3478420ac3342dd989e53899a1f0e13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:33 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8de1b159-33b3-40b1-b24c-411f4ec5b4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:33 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8de1b159-33b3-40b1-b24c-411f4ec5b4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:33 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c809065-e901-488d-b1da-eb1cb197fae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:33 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c809065-e901-488d-b1da-eb1cb197fae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18d6373d-f33d-4e87-81e8-3633eb99e96f', 'volume_name': 'volume-18d6373d-f33d-4e87-81e8-3633eb99e96f', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:33 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (910beb5a-6b4c-491b-bb9b-e928aba2c686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:33 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (910beb5a-6b4c-491b-bb9b-e928aba2c686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:33 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c8243c-bd70-40a8-a9f1-ee0d1df76cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:33 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] Volume 18d6373d-f33d-4e87-81e8-3633eb99e96f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18d6373d-f33d-4e87-81e8-3633eb99e96f', 'volume_size': 1} Apr 25 15:51:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:33 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:51:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1800664022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18d6373d-f33d-4e87-81e8-3633eb99e96f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cff119e44ebb473eaaf92eb6ce2b5bbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:33Z,use_quota=True,user_id='b3478420ac3342dd989e53899a1f0e13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:51:33 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] Creating volume 18d6373d-f33d-4e87-81e8-3633eb99e96f {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:51:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:33 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:51:33 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:51:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:33 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:51:33 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:51:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-18d6373d-f33d-4e87-81e8-3633eb99e96f 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:33 devstack sudo[86538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-18d6373d-f33d-4e87-81e8-3633eb99e96f 1073741824 Apr 25 15:51:33 devstack sudo[86538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:34 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:51:34 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] Flow 'volume_create_manager' (905d72ea-e741-48e4-8961-d8907016f1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:51:34 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b2dc4dc-4615-452a-a4d4-efe12ab9cff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:34 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b2dc4dc-4615-452a-a4d4-efe12ab9cff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:51:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2087243695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80a3a49f-05a4-461c-a560-dbd50840bb18,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f26d321e4fad403f96fc2464beedf804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:34Z,use_quota=True,user_id='da38bf8530894933a3fb58a1909c22c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:34 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7328439-205f-49b4-aef4-fde6a4b7747c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:34 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7328439-205f-49b4-aef4-fde6a4b7747c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:34 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83b17583-13b8-4171-b3ac-d20e3e6ae84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:34 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83b17583-13b8-4171-b3ac-d20e3e6ae84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80a3a49f-05a4-461c-a560-dbd50840bb18', 'volume_name': 'volume-80a3a49f-05a4-461c-a560-dbd50840bb18', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:34 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ee8ebf-9521-4e86-a7b0-57d817b1341d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:34 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ee8ebf-9521-4e86-a7b0-57d817b1341d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:34 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea794d2-fea5-4886-8c88-5bcd52846fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:34 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] Volume 80a3a49f-05a4-461c-a560-dbd50840bb18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80a3a49f-05a4-461c-a560-dbd50840bb18', 'volume_size': 1} Apr 25 15:51:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:34 devstack sudo[86538]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-18d6373d-f33d-4e87-81e8-3633eb99e96f 1073741824" returned: 0 in 1.262s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-18d6373d-f33d-4e87-81e8-3633eb99e96f {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:35 devstack sudo[86574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-18d6373d-f33d-4e87-81e8-3633eb99e96f Apr 25 15:51:35 devstack sudo[86574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:35 devstack sudo[86574]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-18d6373d-f33d-4e87-81e8-3633eb99e96f" returned: 0 in 0.676s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:35 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] <== create_volume: return (2022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:51:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.024s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.323s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:35 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:51:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2087243695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80a3a49f-05a4-461c-a560-dbd50840bb18,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f26d321e4fad403f96fc2464beedf804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:34Z,use_quota=True,user_id='da38bf8530894933a3fb58a1909c22c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:51:35 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] Creating volume 80a3a49f-05a4-461c-a560-dbd50840bb18 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:51:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:35 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:51:35 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:51:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:35 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:51:35 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:51:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-80a3a49f-05a4-461c-a560-dbd50840bb18 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:35 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c8243c-bd70-40a8-a9f1-ee0d1df76cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18d6373d-f33d-4e87-81e8-3633eb99e96f', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:35 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b5a084-0831-4512-8070-70a5d3e91b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:35 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] Volume volume-18d6373d-f33d-4e87-81e8-3633eb99e96f (18d6373d-f33d-4e87-81e8-3633eb99e96f): created successfully Apr 25 15:51:35 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b5a084-0831-4512-8070-70a5d3e91b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:35 devstack sudo[86580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-80a3a49f-05a4-461c-a560-dbd50840bb18 1073741824 Apr 25 15:51:35 devstack sudo[86580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:35 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] Flow 'volume_create_manager' (815a2a22-a49b-47ef-9bdc-e96d9c44b10a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:51:35 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-04bfd859-22be-4210-8fbc-2b8ac19131fa tempest-VolumesListAdminTestJSON-1609339594 None] Created volume successfully. Apr 25 15:51:37 devstack sudo[86580]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-80a3a49f-05a4-461c-a560-dbd50840bb18 1073741824" returned: 0 in 1.568s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-80a3a49f-05a4-461c-a560-dbd50840bb18 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:37 devstack sudo[86586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-80a3a49f-05a4-461c-a560-dbd50840bb18 Apr 25 15:51:37 devstack sudo[86586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:38 devstack sudo[86586]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-80a3a49f-05a4-461c-a560-dbd50840bb18" returned: 0 in 0.960s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:38 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] <== create_volume: return (2597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:51:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.602s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:38 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bea794d2-fea5-4886-8c88-5bcd52846fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80a3a49f-05a4-461c-a560-dbd50840bb18', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:38 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6947ba-2d6f-4af6-a084-bc1b6441fb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:38 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] Volume volume-80a3a49f-05a4-461c-a560-dbd50840bb18 (80a3a49f-05a4-461c-a560-dbd50840bb18): created successfully Apr 25 15:51:38 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6947ba-2d6f-4af6-a084-bc1b6441fb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:38 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] Flow 'volume_create_manager' (905d72ea-e741-48e4-8961-d8907016f1fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:51:38 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-263d3cd2-ba24-4a83-b6ea-5d99909cf410 tempest-VolumesGetTest-1958092712 None] Created volume successfully. Apr 25 15:51:38 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:51:38 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] Flow 'volume_create_manager' (6293c531-0333-4308-9899-a12fbe307063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:51:38 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1193f0fb-ee72-446f-9802-1a949d1b5fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:38 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1193f0fb-ee72-446f-9802-1a949d1b5fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb62626-1ddf-4b7a-a3fd-672f07e8fd90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebb020678bad4d94a8a930ee6481132b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:38Z,use_quota=True,user_id='29e59cf85eff4143ac03da89df54b8c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:38 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fb9f0eb-58a6-4dc6-98dc-6e2513b38c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:38 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fb9f0eb-58a6-4dc6-98dc-6e2513b38c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:38 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ce26d5-a941-4dbe-a204-e0afe8301c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:38 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30ce26d5-a941-4dbe-a204-e0afe8301c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcb62626-1ddf-4b7a-a3fd-672f07e8fd90', 'volume_name': 'volume-bcb62626-1ddf-4b7a-a3fd-672f07e8fd90', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:38 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24926954-5072-4221-bace-c83b6eae6064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:38 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24926954-5072-4221-bace-c83b6eae6064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:38 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57dea398-7246-44e3-b4e7-e73df76ff28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:38 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] Volume bcb62626-1ddf-4b7a-a3fd-672f07e8fd90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcb62626-1ddf-4b7a-a3fd-672f07e8fd90', 'volume_size': 1} Apr 25 15:51:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:38 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb62626-1ddf-4b7a-a3fd-672f07e8fd90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebb020678bad4d94a8a930ee6481132b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:38Z,use_quota=True,user_id='29e59cf85eff4143ac03da89df54b8c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:51:38 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] Creating volume bcb62626-1ddf-4b7a-a3fd-672f07e8fd90 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:51:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:38 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:51:38 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:51:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:38 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:51:38 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:51:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcb62626-1ddf-4b7a-a3fd-672f07e8fd90 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:38 devstack sudo[86598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcb62626-1ddf-4b7a-a3fd-672f07e8fd90 1073741824 Apr 25 15:51:38 devstack sudo[86598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:39 devstack sudo[86598]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcb62626-1ddf-4b7a-a3fd-672f07e8fd90 1073741824" returned: 0 in 0.916s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcb62626-1ddf-4b7a-a3fd-672f07e8fd90 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:39 devstack sudo[86628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcb62626-1ddf-4b7a-a3fd-672f07e8fd90 Apr 25 15:51:39 devstack sudo[86628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:39 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:51:39 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] Flow 'volume_create_manager' (7d9e0906-ab2b-415a-9317-5754595ab8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:51:39 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af37aed5-abaa-4ae6-a7ef-7a699df7b63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:39 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af37aed5-abaa-4ae6-a7ef-7a699df7b63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:51:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1543067861',display_name='tempest-VolumesGetTest-Volume-1703883701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eba16df8-fca9-4ee3-a4a0-aed42e0d3c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f26d321e4fad403f96fc2464beedf804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:40Z,use_quota=True,user_id='da38bf8530894933a3fb58a1909c22c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:39 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c340c96-9bdf-410a-bc59-1434fecfb9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:39 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c340c96-9bdf-410a-bc59-1434fecfb9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:39 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (997c2733-499f-4c8a-aca3-54d0b69fdb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:39 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (997c2733-499f-4c8a-aca3-54d0b69fdb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eba16df8-fca9-4ee3-a4a0-aed42e0d3c3f', 'volume_name': 'volume-eba16df8-fca9-4ee3-a4a0-aed42e0d3c3f', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:39 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da29e2fd-ed26-4eb9-a29b-33413762dc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:39 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da29e2fd-ed26-4eb9-a29b-33413762dc5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:39 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (551b9b31-7d0c-4735-b0b0-618c69fb5ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:39 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] Volume eba16df8-fca9-4ee3-a4a0-aed42e0d3c3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eba16df8-fca9-4ee3-a4a0-aed42e0d3c3f', 'volume_size': 1} Apr 25 15:51:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:40 devstack sudo[86628]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcb62626-1ddf-4b7a-a3fd-672f07e8fd90" returned: 0 in 0.613s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:51:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.393s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:51:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1543067861',display_name='tempest-VolumesGetTest-Volume-1703883701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eba16df8-fca9-4ee3-a4a0-aed42e0d3c3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f26d321e4fad403f96fc2464beedf804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:40Z,use_quota=True,user_id='da38bf8530894933a3fb58a1909c22c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:51:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] Creating volume eba16df8-fca9-4ee3-a4a0-aed42e0d3c3f {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:51:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:51:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:51:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:51:40 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:51:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eba16df8-fca9-4ee3-a4a0-aed42e0d3c3f 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57dea398-7246-44e3-b4e7-e73df76ff28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcb62626-1ddf-4b7a-a3fd-672f07e8fd90', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:40 devstack sudo[86632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eba16df8-fca9-4ee3-a4a0-aed42e0d3c3f 1073741824 Apr 25 15:51:40 devstack sudo[86632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa3a2a6d-c470-43d5-aff4-4ad56da92ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:40 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] Volume volume-bcb62626-1ddf-4b7a-a3fd-672f07e8fd90 (bcb62626-1ddf-4b7a-a3fd-672f07e8fd90): created successfully Apr 25 15:51:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa3a2a6d-c470-43d5-aff4-4ad56da92ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] Flow 'volume_create_manager' (6293c531-0333-4308-9899-a12fbe307063) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:51:40 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-c38524fa-4a1b-453a-8418-cb4b1613e1dc tempest-VolumesListAdminTestJSON-309882479 None] Created volume successfully. Apr 25 15:51:40 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-26dee310-8f56-4e69-88ad-fb92ace37783 tempest-VolumesListAdminTestJSON-309882479 None] Acquiring lock "cinder-bcb62626-1ddf-4b7a-a3fd-672f07e8fd90-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:51:40 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-26dee310-8f56-4e69-88ad-fb92ace37783 tempest-VolumesListAdminTestJSON-309882479 None] Lock "cinder-bcb62626-1ddf-4b7a-a3fd-672f07e8fd90-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:51:40 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-26dee310-8f56-4e69-88ad-fb92ace37783 tempest-VolumesListAdminTestJSON-309882479 None] Acquiring lock "cinder-quobyte-bcb62626-1ddf-4b7a-a3fd-672f07e8fd90" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:51:40 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-26dee310-8f56-4e69-88ad-fb92ace37783 tempest-VolumesListAdminTestJSON-309882479 None] Lock "cinder-quobyte-bcb62626-1ddf-4b7a-a3fd-672f07e8fd90" acquired by "delete_volume" :: waited 0.017s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:51:40 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[540a2a10-1ae3-40dc-8341-ac9f03c2d07d]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:51:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-26dee310-8f56-4e69-88ad-fb92ace37783 tempest-VolumesListAdminTestJSON-309882479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcb62626-1ddf-4b7a-a3fd-672f07e8fd90 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:41 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-00c1e4a4-c908-49cd-a5eb-5608ee88c9c8 tempest-VolumesListAdminTestJSON-1609339594 None] Acquiring lock "cinder-18d6373d-f33d-4e87-81e8-3633eb99e96f-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:51:41 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-00c1e4a4-c908-49cd-a5eb-5608ee88c9c8 tempest-VolumesListAdminTestJSON-1609339594 None] Lock "cinder-18d6373d-f33d-4e87-81e8-3633eb99e96f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:51:41 devstack sudo[86632]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eba16df8-fca9-4ee3-a4a0-aed42e0d3c3f 1073741824" returned: 0 in 0.924s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:41 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-00c1e4a4-c908-49cd-a5eb-5608ee88c9c8 tempest-VolumesListAdminTestJSON-1609339594 None] Acquiring lock "cinder-quobyte-18d6373d-f33d-4e87-81e8-3633eb99e96f" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:51:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eba16df8-fca9-4ee3-a4a0-aed42e0d3c3f {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:41 devstack sudo[86639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcb62626-1ddf-4b7a-a3fd-672f07e8fd90 Apr 25 15:51:41 devstack sudo[86639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:41 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-00c1e4a4-c908-49cd-a5eb-5608ee88c9c8 tempest-VolumesListAdminTestJSON-1609339594 None] Lock "cinder-quobyte-18d6373d-f33d-4e87-81e8-3633eb99e96f" acquired by "delete_volume" :: waited 0.023s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:51:41 devstack sudo[86640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eba16df8-fca9-4ee3-a4a0-aed42e0d3c3f Apr 25 15:51:41 devstack sudo[86640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:41 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a71dc43-d2a1-4c1c-af16-5316caae5b28]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:51:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-00c1e4a4-c908-49cd-a5eb-5608ee88c9c8 tempest-VolumesListAdminTestJSON-1609339594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-18d6373d-f33d-4e87-81e8-3633eb99e96f {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:41 devstack sudo[86644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-18d6373d-f33d-4e87-81e8-3633eb99e96f Apr 25 15:51:41 devstack sudo[86644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:41 devstack sudo[86640]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eba16df8-fca9-4ee3-a4a0-aed42e0d3c3f" returned: 0 in 0.567s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:41 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:51:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:41 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (551b9b31-7d0c-4735-b0b0-618c69fb5ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eba16df8-fca9-4ee3-a4a0-aed42e0d3c3f', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:41 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c744c1ff-0bfd-4381-916b-667502859275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:41 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] Volume volume-eba16df8-fca9-4ee3-a4a0-aed42e0d3c3f (eba16df8-fca9-4ee3-a4a0-aed42e0d3c3f): created successfully Apr 25 15:51:41 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c744c1ff-0bfd-4381-916b-667502859275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:41 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] Flow 'volume_create_manager' (7d9e0906-ab2b-415a-9317-5754595ab8b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:51:41 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-210e01ab-277a-49a6-b255-a4d67a3f447d tempest-VolumesGetTest-1958092712 None] Created volume successfully. Apr 25 15:51:41 devstack sudo[86639]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-26dee310-8f56-4e69-88ad-fb92ace37783 tempest-VolumesListAdminTestJSON-309882479 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcb62626-1ddf-4b7a-a3fd-672f07e8fd90" returned: 0 in 0.795s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-26dee310-8f56-4e69-88ad-fb92ace37783 tempest-VolumesListAdminTestJSON-309882479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcb62626-1ddf-4b7a-a3fd-672f07e8fd90 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:41 devstack sudo[86654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcb62626-1ddf-4b7a-a3fd-672f07e8fd90 Apr 25 15:51:41 devstack sudo[86654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:41 devstack sudo[86644]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-00c1e4a4-c908-49cd-a5eb-5608ee88c9c8 tempest-VolumesListAdminTestJSON-1609339594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-18d6373d-f33d-4e87-81e8-3633eb99e96f" returned: 0 in 0.722s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-00c1e4a4-c908-49cd-a5eb-5608ee88c9c8 tempest-VolumesListAdminTestJSON-1609339594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-18d6373d-f33d-4e87-81e8-3633eb99e96f {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:41 devstack sudo[86659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-18d6373d-f33d-4e87-81e8-3633eb99e96f Apr 25 15:51:41 devstack sudo[86659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:42 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-1efbe348-4d4f-44e2-a26f-dfe5d99d45b1 tempest-VolumesGetTest-1958092712 None] Acquiring lock "cinder-eba16df8-fca9-4ee3-a4a0-aed42e0d3c3f-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:51:42 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-1efbe348-4d4f-44e2-a26f-dfe5d99d45b1 tempest-VolumesGetTest-1958092712 None] Lock "cinder-eba16df8-fca9-4ee3-a4a0-aed42e0d3c3f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:51:42 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-1efbe348-4d4f-44e2-a26f-dfe5d99d45b1 tempest-VolumesGetTest-1958092712 None] Acquiring lock "cinder-quobyte-eba16df8-fca9-4ee3-a4a0-aed42e0d3c3f" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:51:42 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-1efbe348-4d4f-44e2-a26f-dfe5d99d45b1 tempest-VolumesGetTest-1958092712 None] Lock "cinder-quobyte-eba16df8-fca9-4ee3-a4a0-aed42e0d3c3f" acquired by "delete_volume" :: waited 0.023s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:51:42 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5d87c0-a535-4deb-8211-b9851c397cff]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:51:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1efbe348-4d4f-44e2-a26f-dfe5d99d45b1 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eba16df8-fca9-4ee3-a4a0-aed42e0d3c3f {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:42 devstack sudo[86664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eba16df8-fca9-4ee3-a4a0-aed42e0d3c3f Apr 25 15:51:42 devstack sudo[86664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:42 devstack sudo[86654]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-26dee310-8f56-4e69-88ad-fb92ace37783 tempest-VolumesListAdminTestJSON-309882479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcb62626-1ddf-4b7a-a3fd-672f07e8fd90" returned: 0 in 0.944s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:42 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-26dee310-8f56-4e69-88ad-fb92ace37783 tempest-VolumesListAdminTestJSON-309882479 None] Lock "cinder-quobyte-bcb62626-1ddf-4b7a-a3fd-672f07e8fd90" released by "delete_volume" :: held 1.793s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:51:42 devstack sudo[86659]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-00c1e4a4-c908-49cd-a5eb-5608ee88c9c8 tempest-VolumesListAdminTestJSON-1609339594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-18d6373d-f33d-4e87-81e8-3633eb99e96f" returned: 0 in 0.867s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:42 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-00c1e4a4-c908-49cd-a5eb-5608ee88c9c8 tempest-VolumesListAdminTestJSON-1609339594 None] Lock "cinder-quobyte-18d6373d-f33d-4e87-81e8-3633eb99e96f" released by "delete_volume" :: held 1.637s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:51:42 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-26dee310-8f56-4e69-88ad-fb92ace37783 tempest-VolumesListAdminTestJSON-309882479 None] Created reservations ['04ab3a89-284e-4f57-b941-6b7bb8ae40ee', 'b0abdbbe-4b18-49c6-add5-2c3da5f601c9', '13c9972c-bf20-4d5f-94c7-2e0a6ca910c5', '3ea0bb1e-4947-49a9-9c11-0ce3fe013b94'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:51:42 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-00c1e4a4-c908-49cd-a5eb-5608ee88c9c8 tempest-VolumesListAdminTestJSON-1609339594 None] Created reservations ['f98329b7-cca8-4190-b515-7c6125ff758b', '49bdf48c-d5dc-494c-8e32-0c51f79cb170', '6d3229e9-aca5-492d-8f40-7cc3337eeb36', 'b0f519d9-4646-41d0-a14a-efa44353ca66'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:51:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-00c1e4a4-c908-49cd-a5eb-5608ee88c9c8 tempest-VolumesListAdminTestJSON-1609339594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-00c1e4a4-c908-49cd-a5eb-5608ee88c9c8 tempest-VolumesListAdminTestJSON-1609339594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:42 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-00c1e4a4-c908-49cd-a5eb-5608ee88c9c8 tempest-VolumesListAdminTestJSON-1609339594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:51:42 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-00c1e4a4-c908-49cd-a5eb-5608ee88c9c8 tempest-VolumesListAdminTestJSON-1609339594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:51:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-00c1e4a4-c908-49cd-a5eb-5608ee88c9c8 tempest-VolumesListAdminTestJSON-1609339594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-00c1e4a4-c908-49cd-a5eb-5608ee88c9c8 tempest-VolumesListAdminTestJSON-1609339594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:42 devstack sudo[86667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:51:42 devstack sudo[86667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-26dee310-8f56-4e69-88ad-fb92ace37783 tempest-VolumesListAdminTestJSON-309882479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-26dee310-8f56-4e69-88ad-fb92ace37783 tempest-VolumesListAdminTestJSON-309882479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:42 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-26dee310-8f56-4e69-88ad-fb92ace37783 tempest-VolumesListAdminTestJSON-309882479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:51:42 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-26dee310-8f56-4e69-88ad-fb92ace37783 tempest-VolumesListAdminTestJSON-309882479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:51:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-26dee310-8f56-4e69-88ad-fb92ace37783 tempest-VolumesListAdminTestJSON-309882479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-26dee310-8f56-4e69-88ad-fb92ace37783 tempest-VolumesListAdminTestJSON-309882479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:43 devstack sudo[86669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:51:43 devstack sudo[86669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:43 devstack sudo[86664]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1efbe348-4d4f-44e2-a26f-dfe5d99d45b1 tempest-VolumesGetTest-1958092712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eba16df8-fca9-4ee3-a4a0-aed42e0d3c3f" returned: 0 in 0.663s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1efbe348-4d4f-44e2-a26f-dfe5d99d45b1 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eba16df8-fca9-4ee3-a4a0-aed42e0d3c3f {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:43 devstack sudo[86677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eba16df8-fca9-4ee3-a4a0-aed42e0d3c3f Apr 25 15:51:43 devstack sudo[86677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-2d611d92-a013-43fc-927c-dd7bb77ffd84 tempest-VolumesListAdminTestJSON-1609339594 None] Acquiring lock "cinder-00324578-77e6-4493-a83c-5e06a0cf1f9e-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:51:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-2d611d92-a013-43fc-927c-dd7bb77ffd84 tempest-VolumesListAdminTestJSON-1609339594 None] Lock "cinder-00324578-77e6-4493-a83c-5e06a0cf1f9e-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:51:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-2d611d92-a013-43fc-927c-dd7bb77ffd84 tempest-VolumesListAdminTestJSON-1609339594 None] Acquiring lock "cinder-quobyte-00324578-77e6-4493-a83c-5e06a0cf1f9e" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:51:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-2d611d92-a013-43fc-927c-dd7bb77ffd84 tempest-VolumesListAdminTestJSON-1609339594 None] Lock "cinder-quobyte-00324578-77e6-4493-a83c-5e06a0cf1f9e" acquired by "delete_volume" :: waited 0.023s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:51:43 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb29a2eb-d187-42ea-b9d2-db64ef16bfff]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:51:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2d611d92-a013-43fc-927c-dd7bb77ffd84 tempest-VolumesListAdminTestJSON-1609339594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-00324578-77e6-4493-a83c-5e06a0cf1f9e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:43 devstack sudo[86669]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-26dee310-8f56-4e69-88ad-fb92ace37783 tempest-VolumesListAdminTestJSON-309882479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.731s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:43 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-26dee310-8f56-4e69-88ad-fb92ace37783 tempest-VolumesListAdminTestJSON-309882479 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:51:43 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-26dee310-8f56-4e69-88ad-fb92ace37783 tempest-VolumesListAdminTestJSON-309882479 None] Deleted volume successfully. Apr 25 15:51:43 devstack sudo[86683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-00324578-77e6-4493-a83c-5e06a0cf1f9e Apr 25 15:51:43 devstack sudo[86683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-26dee310-8f56-4e69-88ad-fb92ace37783 tempest-VolumesListAdminTestJSON-309882479 None] Lock "cinder-bcb62626-1ddf-4b7a-a3fd-672f07e8fd90-delete_volume" released by "delete_volume" :: held 2.891s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:51:43 devstack sudo[86667]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-00c1e4a4-c908-49cd-a5eb-5608ee88c9c8 tempest-VolumesListAdminTestJSON-1609339594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.887s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:43 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-00c1e4a4-c908-49cd-a5eb-5608ee88c9c8 tempest-VolumesListAdminTestJSON-1609339594 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:51:43 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-00c1e4a4-c908-49cd-a5eb-5608ee88c9c8 tempest-VolumesListAdminTestJSON-1609339594 None] Deleted volume successfully. Apr 25 15:51:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-00c1e4a4-c908-49cd-a5eb-5608ee88c9c8 tempest-VolumesListAdminTestJSON-1609339594 None] Lock "cinder-18d6373d-f33d-4e87-81e8-3633eb99e96f-delete_volume" released by "delete_volume" :: held 2.788s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:51:43 devstack sudo[86677]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1efbe348-4d4f-44e2-a26f-dfe5d99d45b1 tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-eba16df8-fca9-4ee3-a4a0-aed42e0d3c3f" returned: 0 in 0.744s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-1efbe348-4d4f-44e2-a26f-dfe5d99d45b1 tempest-VolumesGetTest-1958092712 None] Lock "cinder-quobyte-eba16df8-fca9-4ee3-a4a0-aed42e0d3c3f" released by "delete_volume" :: held 1.468s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:51:44 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-1efbe348-4d4f-44e2-a26f-dfe5d99d45b1 tempest-VolumesGetTest-1958092712 None] Created reservations ['26696f2d-d142-452f-af37-ac617b093656', 'd8aba33c-11a8-495b-882c-20680e94d168', '5849b529-c41d-40c4-8a92-dd45910bf07c', '194274bf-3e23-4f25-8285-dbd3f97590e5'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:51:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1efbe348-4d4f-44e2-a26f-dfe5d99d45b1 tempest-VolumesGetTest-1958092712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1efbe348-4d4f-44e2-a26f-dfe5d99d45b1 tempest-VolumesGetTest-1958092712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1efbe348-4d4f-44e2-a26f-dfe5d99d45b1 tempest-VolumesGetTest-1958092712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:51:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1efbe348-4d4f-44e2-a26f-dfe5d99d45b1 tempest-VolumesGetTest-1958092712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:51:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1efbe348-4d4f-44e2-a26f-dfe5d99d45b1 tempest-VolumesGetTest-1958092712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1efbe348-4d4f-44e2-a26f-dfe5d99d45b1 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:44 devstack sudo[86687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:51:44 devstack sudo[86687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:44 devstack sudo[86683]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2d611d92-a013-43fc-927c-dd7bb77ffd84 tempest-VolumesListAdminTestJSON-1609339594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-00324578-77e6-4493-a83c-5e06a0cf1f9e" returned: 0 in 0.727s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2d611d92-a013-43fc-927c-dd7bb77ffd84 tempest-VolumesListAdminTestJSON-1609339594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-00324578-77e6-4493-a83c-5e06a0cf1f9e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:44 devstack sudo[86692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-00324578-77e6-4493-a83c-5e06a0cf1f9e Apr 25 15:51:44 devstack sudo[86692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:44 devstack sudo[86687]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1efbe348-4d4f-44e2-a26f-dfe5d99d45b1 tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.623s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:44 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-1efbe348-4d4f-44e2-a26f-dfe5d99d45b1 tempest-VolumesGetTest-1958092712 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:51:44 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-1efbe348-4d4f-44e2-a26f-dfe5d99d45b1 tempest-VolumesGetTest-1958092712 None] Deleted volume successfully. Apr 25 15:51:44 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-1efbe348-4d4f-44e2-a26f-dfe5d99d45b1 tempest-VolumesGetTest-1958092712 None] Lock "cinder-eba16df8-fca9-4ee3-a4a0-aed42e0d3c3f-delete_volume" released by "delete_volume" :: held 2.349s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:51:44 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b8c1011e-0b1e-4469-89cd-0ae68a04cf72 tempest-VolumesGetTest-1958092712 None] Acquiring lock "cinder-80a3a49f-05a4-461c-a560-dbd50840bb18-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:51:44 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b8c1011e-0b1e-4469-89cd-0ae68a04cf72 tempest-VolumesGetTest-1958092712 None] Lock "cinder-80a3a49f-05a4-461c-a560-dbd50840bb18-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:51:44 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b8c1011e-0b1e-4469-89cd-0ae68a04cf72 tempest-VolumesGetTest-1958092712 None] Acquiring lock "cinder-quobyte-80a3a49f-05a4-461c-a560-dbd50840bb18" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:51:44 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b8c1011e-0b1e-4469-89cd-0ae68a04cf72 tempest-VolumesGetTest-1958092712 None] Lock "cinder-quobyte-80a3a49f-05a4-461c-a560-dbd50840bb18" acquired by "delete_volume" :: waited 0.019s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:51:44 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[944f519f-3ba9-4d0a-8695-9c015d6f8d2f]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:51:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b8c1011e-0b1e-4469-89cd-0ae68a04cf72 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-80a3a49f-05a4-461c-a560-dbd50840bb18 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:44 devstack sudo[86692]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2d611d92-a013-43fc-927c-dd7bb77ffd84 tempest-VolumesListAdminTestJSON-1609339594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-00324578-77e6-4493-a83c-5e06a0cf1f9e" returned: 0 in 0.568s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:44 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-2d611d92-a013-43fc-927c-dd7bb77ffd84 tempest-VolumesListAdminTestJSON-1609339594 None] Lock "cinder-quobyte-00324578-77e6-4493-a83c-5e06a0cf1f9e" released by "delete_volume" :: held 1.354s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:51:44 devstack sudo[86696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-80a3a49f-05a4-461c-a560-dbd50840bb18 Apr 25 15:51:44 devstack sudo[86696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:44 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-2d611d92-a013-43fc-927c-dd7bb77ffd84 tempest-VolumesListAdminTestJSON-1609339594 None] Created reservations ['eb6dcfc1-0765-41ce-8318-b71ca4a451fe', 'be423874-eb4b-4d9e-8f20-555f086215da', '8690060e-ddac-429c-931e-2f2f02c5feb6', '12027ca6-2b75-4d3c-833d-304a56f3c6e1'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:51:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-2d611d92-a013-43fc-927c-dd7bb77ffd84 tempest-VolumesListAdminTestJSON-1609339594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-2d611d92-a013-43fc-927c-dd7bb77ffd84 tempest-VolumesListAdminTestJSON-1609339594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:45 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-2d611d92-a013-43fc-927c-dd7bb77ffd84 tempest-VolumesListAdminTestJSON-1609339594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:51:45 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-2d611d92-a013-43fc-927c-dd7bb77ffd84 tempest-VolumesListAdminTestJSON-1609339594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:51:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-2d611d92-a013-43fc-927c-dd7bb77ffd84 tempest-VolumesListAdminTestJSON-1609339594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2d611d92-a013-43fc-927c-dd7bb77ffd84 tempest-VolumesListAdminTestJSON-1609339594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:45 devstack sudo[86698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:51:45 devstack sudo[86698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:45 devstack sudo[86696]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b8c1011e-0b1e-4469-89cd-0ae68a04cf72 tempest-VolumesGetTest-1958092712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-80a3a49f-05a4-461c-a560-dbd50840bb18" returned: 0 in 0.579s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b8c1011e-0b1e-4469-89cd-0ae68a04cf72 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-80a3a49f-05a4-461c-a560-dbd50840bb18 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:45 devstack sudo[86704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-80a3a49f-05a4-461c-a560-dbd50840bb18 Apr 25 15:51:45 devstack sudo[86704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:45 devstack sudo[86698]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2d611d92-a013-43fc-927c-dd7bb77ffd84 tempest-VolumesListAdminTestJSON-1609339594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.500s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:45 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-2d611d92-a013-43fc-927c-dd7bb77ffd84 tempest-VolumesListAdminTestJSON-1609339594 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:51:45 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-2d611d92-a013-43fc-927c-dd7bb77ffd84 tempest-VolumesListAdminTestJSON-1609339594 None] Deleted volume successfully. Apr 25 15:51:45 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-2d611d92-a013-43fc-927c-dd7bb77ffd84 tempest-VolumesListAdminTestJSON-1609339594 None] Lock "cinder-00324578-77e6-4493-a83c-5e06a0cf1f9e-delete_volume" released by "delete_volume" :: held 2.076s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:51:45 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7d6d133a-5b38-43e0-8798-e62a9dfb883c tempest-VolumesListAdminTestJSON-1609339594 None] Acquiring lock "cinder-1e0194db-7d0d-420c-a6b6-b016586c8432-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:51:45 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7d6d133a-5b38-43e0-8798-e62a9dfb883c tempest-VolumesListAdminTestJSON-1609339594 None] Lock "cinder-1e0194db-7d0d-420c-a6b6-b016586c8432-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:51:45 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7d6d133a-5b38-43e0-8798-e62a9dfb883c tempest-VolumesListAdminTestJSON-1609339594 None] Acquiring lock "cinder-quobyte-1e0194db-7d0d-420c-a6b6-b016586c8432" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:51:45 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7d6d133a-5b38-43e0-8798-e62a9dfb883c tempest-VolumesListAdminTestJSON-1609339594 None] Lock "cinder-quobyte-1e0194db-7d0d-420c-a6b6-b016586c8432" acquired by "delete_volume" :: waited 0.013s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:51:45 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7230f26-3bd4-4e61-a5ac-ff23b77a8d8c]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:51:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7d6d133a-5b38-43e0-8798-e62a9dfb883c tempest-VolumesListAdminTestJSON-1609339594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1e0194db-7d0d-420c-a6b6-b016586c8432 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:46 devstack sudo[86704]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b8c1011e-0b1e-4469-89cd-0ae68a04cf72 tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-80a3a49f-05a4-461c-a560-dbd50840bb18" returned: 0 in 0.618s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:46 devstack sudo[86707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1e0194db-7d0d-420c-a6b6-b016586c8432 Apr 25 15:51:46 devstack sudo[86707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:46 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b8c1011e-0b1e-4469-89cd-0ae68a04cf72 tempest-VolumesGetTest-1958092712 None] Lock "cinder-quobyte-80a3a49f-05a4-461c-a560-dbd50840bb18" released by "delete_volume" :: held 1.243s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:51:46 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-b8c1011e-0b1e-4469-89cd-0ae68a04cf72 tempest-VolumesGetTest-1958092712 None] Created reservations ['e3d70627-b3b4-4dd2-b41b-8f75c381bbf1', '2e25289a-02bf-4d5d-aac4-f19149b384e8', '19a69cc9-120e-48f6-b592-1fcdb4c4f9de', '10f7798f-e2e2-4eb3-846f-1483b204b320'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:51:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b8c1011e-0b1e-4469-89cd-0ae68a04cf72 tempest-VolumesGetTest-1958092712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b8c1011e-0b1e-4469-89cd-0ae68a04cf72 tempest-VolumesGetTest-1958092712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:46 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b8c1011e-0b1e-4469-89cd-0ae68a04cf72 tempest-VolumesGetTest-1958092712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:51:46 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b8c1011e-0b1e-4469-89cd-0ae68a04cf72 tempest-VolumesGetTest-1958092712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:51:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b8c1011e-0b1e-4469-89cd-0ae68a04cf72 tempest-VolumesGetTest-1958092712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b8c1011e-0b1e-4469-89cd-0ae68a04cf72 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:46 devstack sudo[86709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:51:46 devstack sudo[86709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:46 devstack sudo[86707]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7d6d133a-5b38-43e0-8798-e62a9dfb883c tempest-VolumesListAdminTestJSON-1609339594 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1e0194db-7d0d-420c-a6b6-b016586c8432" returned: 0 in 0.774s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7d6d133a-5b38-43e0-8798-e62a9dfb883c tempest-VolumesListAdminTestJSON-1609339594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1e0194db-7d0d-420c-a6b6-b016586c8432 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:46 devstack sudo[86715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1e0194db-7d0d-420c-a6b6-b016586c8432 Apr 25 15:51:46 devstack sudo[86715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:46 devstack sudo[86709]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b8c1011e-0b1e-4469-89cd-0ae68a04cf72 tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.678s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:46 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-b8c1011e-0b1e-4469-89cd-0ae68a04cf72 tempest-VolumesGetTest-1958092712 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:51:46 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-b8c1011e-0b1e-4469-89cd-0ae68a04cf72 tempest-VolumesGetTest-1958092712 None] Deleted volume successfully. Apr 25 15:51:46 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b8c1011e-0b1e-4469-89cd-0ae68a04cf72 tempest-VolumesGetTest-1958092712 None] Lock "cinder-80a3a49f-05a4-461c-a560-dbd50840bb18-delete_volume" released by "delete_volume" :: held 2.132s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:51:47 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:51:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] Flow 'volume_create_manager' (e5a94b2f-73f0-4f4a-a199-e4060ac836e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:51:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef146582-f305-4161-bc06-3250b7932277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef146582-f305-4161-bc06-3250b7932277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-336948170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ddb6a01-6322-4c50-9ebe-57c85d6c75ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f26d321e4fad403f96fc2464beedf804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:47Z,use_quota=True,user_id='da38bf8530894933a3fb58a1909c22c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:47 devstack sudo[86715]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf21b432-a884-4bb5-85a9-bfa13a153add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf21b432-a884-4bb5-85a9-bfa13a153add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2188c0c-f401-4b92-b87e-7a818e36de85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2188c0c-f401-4b92-b87e-7a818e36de85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ddb6a01-6322-4c50-9ebe-57c85d6c75ab', 'volume_name': 'volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a14db9b-d463-4794-bc7e-160e91f7e28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a14db9b-d463-4794-bc7e-160e91f7e28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c12f0fd-7fb9-4820-b0cf-c12ec59779e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:47 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] Volume 0ddb6a01-6322-4c50-9ebe-57c85d6c75ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab', 'volume_size': 1} Apr 25 15:51:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-336948170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ddb6a01-6322-4c50-9ebe-57c85d6c75ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f26d321e4fad403f96fc2464beedf804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:47Z,use_quota=True,user_id='da38bf8530894933a3fb58a1909c22c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:51:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] Creating volume 0ddb6a01-6322-4c50-9ebe-57c85d6c75ab {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:51:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:51:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:51:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:51:47 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:51:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7d6d133a-5b38-43e0-8798-e62a9dfb883c tempest-VolumesListAdminTestJSON-1609339594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1e0194db-7d0d-420c-a6b6-b016586c8432" returned: 0 in 0.895s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:47 devstack sudo[86718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab 1073741824 Apr 25 15:51:47 devstack sudo[86718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:47 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7d6d133a-5b38-43e0-8798-e62a9dfb883c tempest-VolumesListAdminTestJSON-1609339594 None] Lock "cinder-quobyte-1e0194db-7d0d-420c-a6b6-b016586c8432" released by "delete_volume" :: held 1.749s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:51:47 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-7d6d133a-5b38-43e0-8798-e62a9dfb883c tempest-VolumesListAdminTestJSON-1609339594 None] Created reservations ['41921fe7-ac06-4c01-9a2f-1bf995d8c95c', '8c8b2a14-7eb1-4f93-858e-c2483bba3b87', 'bc6bf778-f50c-4018-a882-926a121280a6', '7840e614-cbcd-4335-b4d3-370407fb50b7'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:51:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7d6d133a-5b38-43e0-8798-e62a9dfb883c tempest-VolumesListAdminTestJSON-1609339594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7d6d133a-5b38-43e0-8798-e62a9dfb883c tempest-VolumesListAdminTestJSON-1609339594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-7d6d133a-5b38-43e0-8798-e62a9dfb883c tempest-VolumesListAdminTestJSON-1609339594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:51:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-7d6d133a-5b38-43e0-8798-e62a9dfb883c tempest-VolumesListAdminTestJSON-1609339594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:51:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7d6d133a-5b38-43e0-8798-e62a9dfb883c tempest-VolumesListAdminTestJSON-1609339594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7d6d133a-5b38-43e0-8798-e62a9dfb883c tempest-VolumesListAdminTestJSON-1609339594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:47 devstack sudo[86720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:51:47 devstack sudo[86720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:48 devstack sudo[86718]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab 1073741824" returned: 0 in 0.989s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:48 devstack sudo[86728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab Apr 25 15:51:48 devstack sudo[86728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:48 devstack sudo[86720]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7d6d133a-5b38-43e0-8798-e62a9dfb883c tempest-VolumesListAdminTestJSON-1609339594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.903s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:48 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-7d6d133a-5b38-43e0-8798-e62a9dfb883c tempest-VolumesListAdminTestJSON-1609339594 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:51:48 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-7d6d133a-5b38-43e0-8798-e62a9dfb883c tempest-VolumesListAdminTestJSON-1609339594 None] Deleted volume successfully. Apr 25 15:51:48 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7d6d133a-5b38-43e0-8798-e62a9dfb883c tempest-VolumesListAdminTestJSON-1609339594 None] Lock "cinder-1e0194db-7d0d-420c-a6b6-b016586c8432-delete_volume" released by "delete_volume" :: held 2.977s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:51:49 devstack sudo[86728]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab" returned: 0 in 0.858s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:49 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] <== create_volume: return (1901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:51:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:49 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c12f0fd-7fb9-4820-b0cf-c12ec59779e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:49 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b8dfcbe-733b-42aa-87c8-415fb15af943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:49 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] Volume volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab (0ddb6a01-6322-4c50-9ebe-57c85d6c75ab): created successfully Apr 25 15:51:49 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b8dfcbe-733b-42aa-87c8-415fb15af943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:49 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] Flow 'volume_create_manager' (e5a94b2f-73f0-4f4a-a199-e4060ac836e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:51:49 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-d87eb7f3-ace3-4d0c-9727-763d97a16b8b tempest-VolumesGetTest-1958092712 None] Created volume successfully. Apr 25 15:51:51 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:51:51 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Flow 'volume_create_manager' (d0bb2c45-805b-486a-a1b6-490c88cc66ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:51:51 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334f7bd5-8717-401b-947d-1a139cdc0626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:51 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334f7bd5-8717-401b-947d-1a139cdc0626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1662905362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72f1afe3-890a-49c6-a86c-c5c70f43d8e3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f26d321e4fad403f96fc2464beedf804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=0ddb6a01-6322-4c50-9ebe-57c85d6c75ab,status='creating',terminated_at=None,updated_at=2026-04-25T13:51:51Z,use_quota=True,user_id='da38bf8530894933a3fb58a1909c22c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:51 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8f98d75-ba53-4c02-a7b1-88d965b91bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:51 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8f98d75-ba53-4c02-a7b1-88d965b91bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:51 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7180733-a6a6-460b-82d9-65878a0ffac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:51 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7180733-a6a6-460b-82d9-65878a0ffac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '72f1afe3-890a-49c6-a86c-c5c70f43d8e3', 'volume_name': 'volume-72f1afe3-890a-49c6-a86c-c5c70f43d8e3', 'volume_size': 1, 'source_volid': '0ddb6a01-6322-4c50-9ebe-57c85d6c75ab', 'source_volstatus': 'available'}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:51 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30bb2251-80d5-4dc4-a3ba-3ae55a8632f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:51 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30bb2251-80d5-4dc4-a3ba-3ae55a8632f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:51:51 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ffe1d51-1853-418c-aebf-92c81fe77078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:51:51 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Volume 72f1afe3-890a-49c6-a86c-c5c70f43d8e3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-72f1afe3-890a-49c6-a86c-c5c70f43d8e3', 'volume_size': 1, 'source_volid': '0ddb6a01-6322-4c50-9ebe-57c85d6c75ab', 'source_volstatus': 'available'} Apr 25 15:51:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:51 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Cloning volume 0ddb6a01-6322-4c50-9ebe-57c85d6c75ab to volume 72f1afe3-890a-49c6-a86c-c5c70f43d8e3 Apr 25 15:51:51 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Creating offline snapshot 6940b583-82f3-4f75-834d-c315df6e362e of volume 0ddb6a01-6322-4c50-9ebe-57c85d6c75ab {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 15:51:51 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[f064ba07-a781-410c-8df2-f5a411fc451a]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:51:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:51 devstack sudo[86770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab Apr 25 15:51:51 devstack sudo[86770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:52 devstack sudo[86770]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab" returned: 0 in 0.884s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab.6940b583-82f3-4f75-834d-c315df6e362e 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:52 devstack sudo[86776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab.6940b583-82f3-4f75-834d-c315df6e362e 1G Apr 25 15:51:52 devstack sudo[86776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:53 devstack sudo[86776]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab.6940b583-82f3-4f75-834d-c315df6e362e 1G" returned: 0 in 0.922s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab.6940b583-82f3-4f75-834d-c315df6e362e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:53 devstack sudo[86781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab.6940b583-82f3-4f75-834d-c315df6e362e Apr 25 15:51:53 devstack sudo[86781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:54 devstack sudo[86781]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab.6940b583-82f3-4f75-834d-c315df6e362e" returned: 0 in 0.717s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:54 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab.6940b583-82f3-4f75-834d-c315df6e362e is being set with open permissions: ugo+rw Apr 25 15:51:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab.6940b583-82f3-4f75-834d-c315df6e362e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:54 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9b95eaa0-c000-470d-9aca-9e7ca374e75f tempest-VolumesNegativeTest-1933649986 None] Acquiring lock "cinder-2c32a2ed-eb23-4e94-8b5b-a455f39bda4e-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:51:54 devstack sudo[86790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab.6940b583-82f3-4f75-834d-c315df6e362e Apr 25 15:51:54 devstack sudo[86790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:54 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9b95eaa0-c000-470d-9aca-9e7ca374e75f tempest-VolumesNegativeTest-1933649986 None] Lock "cinder-2c32a2ed-eb23-4e94-8b5b-a455f39bda4e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:51:54 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9b95eaa0-c000-470d-9aca-9e7ca374e75f tempest-VolumesNegativeTest-1933649986 None] Acquiring lock "cinder-quobyte-2c32a2ed-eb23-4e94-8b5b-a455f39bda4e" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:51:54 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9b95eaa0-c000-470d-9aca-9e7ca374e75f tempest-VolumesNegativeTest-1933649986 None] Lock "cinder-quobyte-2c32a2ed-eb23-4e94-8b5b-a455f39bda4e" acquired by "delete_volume" :: waited 0.014s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:51:54 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[63de791a-2eae-4dda-8ed7-148df5215b29]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:51:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9b95eaa0-c000-470d-9aca-9e7ca374e75f tempest-VolumesNegativeTest-1933649986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2c32a2ed-eb23-4e94-8b5b-a455f39bda4e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:54 devstack sudo[86792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2c32a2ed-eb23-4e94-8b5b-a455f39bda4e Apr 25 15:51:54 devstack sudo[86792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:54 devstack sudo[86790]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab.6940b583-82f3-4f75-834d-c315df6e362e" returned: 0 in 0.662s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:54 devstack sudo[86803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab.info Apr 25 15:51:54 devstack sudo[86803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:55 devstack sudo[86792]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9b95eaa0-c000-470d-9aca-9e7ca374e75f tempest-VolumesNegativeTest-1933649986 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2c32a2ed-eb23-4e94-8b5b-a455f39bda4e" returned: 0 in 0.667s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9b95eaa0-c000-470d-9aca-9e7ca374e75f tempest-VolumesNegativeTest-1933649986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2c32a2ed-eb23-4e94-8b5b-a455f39bda4e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:55 devstack sudo[86806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2c32a2ed-eb23-4e94-8b5b-a455f39bda4e Apr 25 15:51:55 devstack sudo[86806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:55 devstack sudo[86803]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab.info" returned: 0 in 0.547s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:55 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab.info is being set with open permissions: ugo+rw Apr 25 15:51:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:55 devstack sudo[86809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab.info Apr 25 15:51:55 devstack sudo[86809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:55 devstack sudo[86806]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9b95eaa0-c000-470d-9aca-9e7ca374e75f tempest-VolumesNegativeTest-1933649986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2c32a2ed-eb23-4e94-8b5b-a455f39bda4e" returned: 0 in 0.533s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:55 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9b95eaa0-c000-470d-9aca-9e7ca374e75f tempest-VolumesNegativeTest-1933649986 None] Lock "cinder-quobyte-2c32a2ed-eb23-4e94-8b5b-a455f39bda4e" released by "delete_volume" :: held 1.258s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:51:55 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-9b95eaa0-c000-470d-9aca-9e7ca374e75f tempest-VolumesNegativeTest-1933649986 None] Created reservations ['a931cf3e-6fbc-447c-967b-b4c50d2597bb', 'c38c3658-3dd6-4e1e-9f3b-72947895d0ec', 'd500a1c3-78ae-4842-b33f-dbeed05e22f6', '9e908834-543e-44f0-b36c-78a45aecebfb'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:51:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9b95eaa0-c000-470d-9aca-9e7ca374e75f tempest-VolumesNegativeTest-1933649986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9b95eaa0-c000-470d-9aca-9e7ca374e75f tempest-VolumesNegativeTest-1933649986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:55 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-9b95eaa0-c000-470d-9aca-9e7ca374e75f tempest-VolumesNegativeTest-1933649986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:51:55 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-9b95eaa0-c000-470d-9aca-9e7ca374e75f tempest-VolumesNegativeTest-1933649986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:51:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9b95eaa0-c000-470d-9aca-9e7ca374e75f tempest-VolumesNegativeTest-1933649986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9b95eaa0-c000-470d-9aca-9e7ca374e75f tempest-VolumesNegativeTest-1933649986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:55 devstack sudo[86815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:51:55 devstack sudo[86815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:56 devstack sudo[86809]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab.info" returned: 0 in 0.589s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:56 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Acquiring lock "cinder-quobyte-72f1afe3-890a-49c6-a86c-c5c70f43d8e3" by "_copy_volume_from_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:51:56 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Lock "cinder-quobyte-72f1afe3-890a-49c6-a86c-c5c70f43d8e3" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:51:56 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] snapshot: 6940b583-82f3-4f75-834d-c315df6e362e, volume: 72f1afe3-890a-49c6-a86c-c5c70f43d8e3, {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 25 15:51:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:51:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:51:56 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:51:56 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:51:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:51:56 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f23771-1cb4-4fff-a1e4-f383e2f0d4ca]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:51:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab.6940b583-82f3-4f75-834d-c315df6e362e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:56 devstack sudo[86821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab.6940b583-82f3-4f75-834d-c315df6e362e Apr 25 15:51:56 devstack sudo[86821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:56 devstack sudo[86815]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9b95eaa0-c000-470d-9aca-9e7ca374e75f tempest-VolumesNegativeTest-1933649986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.705s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:56 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-9b95eaa0-c000-470d-9aca-9e7ca374e75f tempest-VolumesNegativeTest-1933649986 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:51:56 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-9b95eaa0-c000-470d-9aca-9e7ca374e75f tempest-VolumesNegativeTest-1933649986 None] Deleted volume successfully. Apr 25 15:51:56 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9b95eaa0-c000-470d-9aca-9e7ca374e75f tempest-VolumesNegativeTest-1933649986 None] Lock "cinder-2c32a2ed-eb23-4e94-8b5b-a455f39bda4e-delete_volume" released by "delete_volume" :: held 2.222s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:51:56 devstack sudo[86821]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab.6940b583-82f3-4f75-834d-c315df6e362e" returned: 0 in 0.765s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:56 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:51:56 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] will copy from snapshot at /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 25 15:51:56 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Creating direct copy from snapshot {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 25 15:51:56 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[05407ed8-19b3-47d4-8423-d8954d7ad35b]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:51:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:57 devstack sudo[86836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab Apr 25 15:51:57 devstack sudo[86836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:51:57 devstack sudo[86836]: pam_unix(sudo:session): session closed for user root Apr 25 15:51:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab" returned: 0 in 0.982s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:51:57 devstack cinder-volume[81828]: DEBUG cinder.utils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Path /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72f1afe3-890a-49c6-a86c-c5c70f43d8e3 not found in is_blk_device check {{(pid=81828) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 25 15:51:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72f1afe3-890a-49c6-a86c-c5c70f43d8e3 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:51:57 devstack sudo[86869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72f1afe3-890a-49c6-a86c-c5c70f43d8e3 Apr 25 15:51:57 devstack sudo[86869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:00 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:52:00 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] Flow 'volume_create_manager' (c54c480f-5e92-4113-8c78-7ed69eeff95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:52:00 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a878c47-a15e-486f-84f1-df974700363a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:00 devstack cinder-volume[81828]: DEBUG oslo_service.periodic_task [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81828) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 25 15:52:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:52:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:52:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:52:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:52:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:00 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a878c47-a15e-486f-84f1-df974700363a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2074251070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5099828b-ed0f-44d6-83b8-ca508f5dc489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e4e3ed189774e1fa8a0d48c188ed795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:00Z,use_quota=True,user_id='8acf629ab91547b2af8063271744afce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:00 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ec07dc-ff2e-41d4-90b8-9fb6b8314b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:00 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ec07dc-ff2e-41d4-90b8-9fb6b8314b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:00 devstack sudo[86932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:52:00 devstack sudo[86932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:00 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5ed733d-cc41-4a8f-95d0-7188e23688f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:00 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5ed733d-cc41-4a8f-95d0-7188e23688f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5099828b-ed0f-44d6-83b8-ca508f5dc489', 'volume_name': 'volume-5099828b-ed0f-44d6-83b8-ca508f5dc489', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:00 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d973aef6-1ea6-4254-8dd4-fedd1ecb23bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:00 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d973aef6-1ea6-4254-8dd4-fedd1ecb23bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:00 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c229d007-bed2-4e02-ba6b-26f46c6336d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:00 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] Volume 5099828b-ed0f-44d6-83b8-ca508f5dc489: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5099828b-ed0f-44d6-83b8-ca508f5dc489', 'volume_size': 1} Apr 25 15:52:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:52:01 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:52:01 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] Flow 'volume_create_manager' (2895778a-6ed9-4146-a45d-a12cbd2d393c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:52:01 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f4883a0-20aa-4e9b-b386-d10b49466632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:01 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f4883a0-20aa-4e9b-b386-d10b49466632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1183683696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef032f44-f40e-4e02-860c-d4b3d377fc8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636d98f64371437c869a58c1ce2c0ea4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:01Z,use_quota=True,user_id='25a02d026c48422d8e9d45e35bd53404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:01 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725751c6-cd58-4feb-81ca-3c7f64a1b5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:01 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (725751c6-cd58-4feb-81ca-3c7f64a1b5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:01 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f529bde-1455-44f0-b4c2-8a49201554aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:01 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f529bde-1455-44f0-b4c2-8a49201554aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef032f44-f40e-4e02-860c-d4b3d377fc8b', 'volume_name': 'volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:01 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a98a2f3-8431-4449-8732-4307d96d58bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:01 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a98a2f3-8431-4449-8732-4307d96d58bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:01 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27aee2f9-784a-4b67-9235-e2be614c1ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:01 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] Volume ef032f44-f40e-4e02-860c-d4b3d377fc8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b', 'volume_size': 1} Apr 25 15:52:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:52:02 devstack sudo[86932]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 2.277s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:02 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:52:08 devstack sudo[86869]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72f1afe3-890a-49c6-a86c-c5c70f43d8e3" returned: 0 in 10.322s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:08 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a459ca-077f-4c9e-9855-d1198a64b29e]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:52:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:08 devstack sudo[86939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab Apr 25 15:52:08 devstack sudo[86939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:09 devstack sudo[86939]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab" returned: 0 in 1.110s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:09 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Image conversion details: src /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab, size 1024.00 MB, duration 10.32 sec, destination /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72f1afe3-890a-49c6-a86c-c5c70f43d8e3 {{(pid=81828) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 15:52:09 devstack cinder-volume[81828]: INFO cinder.image.image_utils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Converted 1024.00 MB image at 99.18 MB/s Apr 25 15:52:09 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72f1afe3-890a-49c6-a86c-c5c70f43d8e3 is being set with open permissions: ugo+rw Apr 25 15:52:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72f1afe3-890a-49c6-a86c-c5c70f43d8e3 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:09 devstack sudo[86944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72f1afe3-890a-49c6-a86c-c5c70f43d8e3 Apr 25 15:52:09 devstack sudo[86944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:09 devstack sudo[86944]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72f1afe3-890a-49c6-a86c-c5c70f43d8e3" returned: 0 in 0.542s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:09 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Lock "cinder-quobyte-72f1afe3-890a-49c6-a86c-c5c70f43d8e3" released by "_copy_volume_from_snapshot" :: held 13.862s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:52:09 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Acquiring lock "cinder-quobyte-6940b583-82f3-4f75-834d-c315df6e362e" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:52:10 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Lock "cinder-quobyte-6940b583-82f3-4f75-834d-c315df6e362e" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:52:10 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Deleting offline snapshot 6940b583-82f3-4f75-834d-c315df6e362e of volume 0ddb6a01-6322-4c50-9ebe-57c85d6c75ab {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 15:52:10 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] snapshot_file for this snap is: volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab.6940b583-82f3-4f75-834d-c315df6e362e {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 15:52:10 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[c242279d-3bd4-4f65-9ccc-c2fcd42f876d]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:52:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab.6940b583-82f3-4f75-834d-c315df6e362e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:10 devstack sudo[86979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab.6940b583-82f3-4f75-834d-c315df6e362e Apr 25 15:52:10 devstack sudo[86979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:10 devstack sudo[86979]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab.6940b583-82f3-4f75-834d-c315df6e362e" returned: 0 in 0.938s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:11 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:52:11 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d82b29-1197-4f4d-b938-da36839f89e1]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:52:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:11 devstack sudo[86986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab Apr 25 15:52:11 devstack sudo[86986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:11 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:UPDATE=92,cinder:SELECT=69,cinder:DELETE=5,cinder:INSERT=23 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:52:11 devstack sudo[86986]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab" returned: 0 in 0.801s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab.6940b583-82f3-4f75-834d-c315df6e362e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:12 devstack sudo[87002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab.6940b583-82f3-4f75-834d-c315df6e362e Apr 25 15:52:12 devstack sudo[87002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:12 devstack sudo[87002]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab.6940b583-82f3-4f75-834d-c315df6e362e" returned: 0 in 0.980s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab.6940b583-82f3-4f75-834d-c315df6e362e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:12 devstack sudo[87021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab.6940b583-82f3-4f75-834d-c315df6e362e Apr 25 15:52:12 devstack sudo[87021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:13 devstack sudo[87021]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab.6940b583-82f3-4f75-834d-c315df6e362e" returned: 0 in 0.466s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:13 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Lock "cinder-quobyte-6940b583-82f3-4f75-834d-c315df6e362e" released by "_delete_snapshot" :: held 3.342s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:52:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.827s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.836s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:52:13 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2074251070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5099828b-ed0f-44d6-83b8-ca508f5dc489,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e4e3ed189774e1fa8a0d48c188ed795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:00Z,use_quota=True,user_id='8acf629ab91547b2af8063271744afce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:52:13 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] Creating volume 5099828b-ed0f-44d6-83b8-ca508f5dc489 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:52:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:52:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:52:13 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:52:13 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:52:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:13 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:52:13 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:52:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5099828b-ed0f-44d6-83b8-ca508f5dc489 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:13 devstack sudo[87037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5099828b-ed0f-44d6-83b8-ca508f5dc489 1073741824 Apr 25 15:52:13 devstack sudo[87037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ffe1d51-1853-418c-aebf-92c81fe77078) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72f1afe3-890a-49c6-a86c-c5c70f43d8e3', 'volume_size': 1, 'source_volid': '0ddb6a01-6322-4c50-9ebe-57c85d6c75ab', 'source_volstatus': 'available'}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec79476-59bf-498e-aa66-6350f5991bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:13 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Volume volume-72f1afe3-890a-49c6-a86c-c5c70f43d8e3 (72f1afe3-890a-49c6-a86c-c5c70f43d8e3): created successfully Apr 25 15:52:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec79476-59bf-498e-aa66-6350f5991bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Flow 'volume_create_manager' (d0bb2c45-805b-486a-a1b6-490c88cc66ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:52:13 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-0281ee53-8794-4ac1-b7c2-8e9917801695 tempest-VolumesGetTest-1958092712 None] Created volume successfully. Apr 25 15:52:14 devstack sudo[87037]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5099828b-ed0f-44d6-83b8-ca508f5dc489 1073741824" returned: 0 in 0.714s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5099828b-ed0f-44d6-83b8-ca508f5dc489 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:14 devstack sudo[87061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5099828b-ed0f-44d6-83b8-ca508f5dc489 Apr 25 15:52:14 devstack sudo[87061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:14 devstack sudo[87061]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5099828b-ed0f-44d6-83b8-ca508f5dc489" returned: 0 in 0.509s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:14 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:52:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.959s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:52:14 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1183683696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef032f44-f40e-4e02-860c-d4b3d377fc8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636d98f64371437c869a58c1ce2c0ea4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:01Z,use_quota=True,user_id='25a02d026c48422d8e9d45e35bd53404',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:52:14 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] Creating volume ef032f44-f40e-4e02-860c-d4b3d377fc8b {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:52:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:52:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:52:14 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:52:14 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:52:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:14 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:52:14 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:52:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c229d007-bed2-4e02-ba6b-26f46c6336d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5099828b-ed0f-44d6-83b8-ca508f5dc489', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c92c44d-95af-45ef-bb28-32f544f985db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:14 devstack sudo[87064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b 1073741824 Apr 25 15:52:14 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] Volume volume-5099828b-ed0f-44d6-83b8-ca508f5dc489 (5099828b-ed0f-44d6-83b8-ca508f5dc489): created successfully Apr 25 15:52:14 devstack sudo[87064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c92c44d-95af-45ef-bb28-32f544f985db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] Flow 'volume_create_manager' (c54c480f-5e92-4113-8c78-7ed69eeff95d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:52:14 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-4a65d2fb-2069-47a1-94be-fcead6f9d3d2 tempest-VolumesTransfersV355Test-39770509 None] Created volume successfully. Apr 25 15:52:14 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:52:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] Flow 'volume_create_manager' (c438359d-e5ec-46fc-80ef-1b35cdba55c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:52:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33f6634f-ecb9-472d-85bf-8988dcf00ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33f6634f-ecb9-472d-85bf-8988dcf00ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:52:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-678730295',display_name='tempest-VolumesGetTest-Volume-289170859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4efe836-11b6-4f98-ba89-ec37c738456b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f26d321e4fad403f96fc2464beedf804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:15Z,use_quota=True,user_id='da38bf8530894933a3fb58a1909c22c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1fc704-3841-432e-8945-26dc33b8126d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1fc704-3841-432e-8945-26dc33b8126d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d9f78f-a613-4764-a48f-62e2d56962f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26d9f78f-a613-4764-a48f-62e2d56962f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4efe836-11b6-4f98-ba89-ec37c738456b', 'volume_name': 'volume-a4efe836-11b6-4f98-ba89-ec37c738456b', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d4cfdc2-aba7-41dc-a8c6-58ff8724657a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d4cfdc2-aba7-41dc-a8c6-58ff8724657a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1c31728-faca-4b4b-b934-b6e7bcc383ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:15 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] Volume a4efe836-11b6-4f98-ba89-ec37c738456b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4efe836-11b6-4f98-ba89-ec37c738456b', 'volume_size': 1} Apr 25 15:52:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:52:15 devstack sudo[87064]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b 1073741824" returned: 0 in 0.745s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:15 devstack sudo[87071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b Apr 25 15:52:15 devstack sudo[87071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:15 devstack sudo[87071]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b" returned: 0 in 0.477s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:52:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.924s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:52:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:52:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-678730295',display_name='tempest-VolumesGetTest-Volume-289170859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4efe836-11b6-4f98-ba89-ec37c738456b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f26d321e4fad403f96fc2464beedf804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:15Z,use_quota=True,user_id='da38bf8530894933a3fb58a1909c22c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:52:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] Creating volume a4efe836-11b6-4f98-ba89-ec37c738456b {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:52:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:52:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:52:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:52:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:52:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:52:15 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:52:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a4efe836-11b6-4f98-ba89-ec37c738456b 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27aee2f9-784a-4b67-9235-e2be614c1ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2891263d-ed5a-4cca-9d83-2c0022f01eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:16 devstack sudo[87074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a4efe836-11b6-4f98-ba89-ec37c738456b 1073741824 Apr 25 15:52:16 devstack sudo[87074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:16 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] Volume volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b (ef032f44-f40e-4e02-860c-d4b3d377fc8b): created successfully Apr 25 15:52:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2891263d-ed5a-4cca-9d83-2c0022f01eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] Flow 'volume_create_manager' (2895778a-6ed9-4146-a45d-a12cbd2d393c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:52:16 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-45ca048a-430c-4969-bfcb-fc3e590df256 tempest-VolumesSnapshotListTestJSON-1273609158 None] Created volume successfully. Apr 25 15:52:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-25e618d6-a784-4c6f-949a-be54a25b7f0f tempest-VolumesSnapshotListTestJSON-1273609158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:52:16 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-de9e3588-4186-4883-b41f-43bde441f3d5 tempest-VolumesTransfersV355Test-1844541049 None] Transfer volume completed successfully. Apr 25 15:52:16 devstack sudo[87074]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a4efe836-11b6-4f98-ba89-ec37c738456b 1073741824" returned: 0 in 0.698s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a4efe836-11b6-4f98-ba89-ec37c738456b {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:16 devstack sudo[87079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a4efe836-11b6-4f98-ba89-ec37c738456b Apr 25 15:52:16 devstack sudo[87079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:17 devstack sudo[87079]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a4efe836-11b6-4f98-ba89-ec37c738456b" returned: 0 in 0.475s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:17 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:52:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-25e618d6-a784-4c6f-949a-be54a25b7f0f tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.676s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:52:17 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:UPDATE=108,cinder:DELETE=14,cinder:SELECT=71,cinder:INSERT=24 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:52:17 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1c31728-faca-4b4b-b934-b6e7bcc383ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4efe836-11b6-4f98-ba89-ec37c738456b', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:17 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f6fa99-f225-4eb7-bda5-737ddbca8b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:17 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-25e618d6-a784-4c6f-949a-be54a25b7f0f tempest-VolumesSnapshotListTestJSON-1273609158 None] Creating offline snapshot 60b6814d-2243-4a40-9385-ab9874f61651 of volume ef032f44-f40e-4e02-860c-d4b3d377fc8b {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 15:52:17 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef0c48b-97cd-494c-ae49-4ea56779c81f]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:52:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-25e618d6-a784-4c6f-949a-be54a25b7f0f tempest-VolumesSnapshotListTestJSON-1273609158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:17 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] Volume volume-a4efe836-11b6-4f98-ba89-ec37c738456b (a4efe836-11b6-4f98-ba89-ec37c738456b): created successfully Apr 25 15:52:17 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9f6fa99-f225-4eb7-bda5-737ddbca8b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:17 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] Flow 'volume_create_manager' (c438359d-e5ec-46fc-80ef-1b35cdba55c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:52:17 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-124965bf-f614-4159-adf0-141698f9cdde tempest-VolumesGetTest-1958092712 None] Created volume successfully. Apr 25 15:52:17 devstack sudo[87088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b Apr 25 15:52:17 devstack sudo[87088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:17 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-64d5d6ed-1725-4406-83cc-09fa36d9e180 tempest-VolumesTransfersV355Test-258729424 None] Acquiring lock "cinder-5099828b-ed0f-44d6-83b8-ca508f5dc489-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:52:17 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-64d5d6ed-1725-4406-83cc-09fa36d9e180 tempest-VolumesTransfersV355Test-258729424 None] Lock "cinder-5099828b-ed0f-44d6-83b8-ca508f5dc489-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:52:17 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-64d5d6ed-1725-4406-83cc-09fa36d9e180 tempest-VolumesTransfersV355Test-258729424 None] Acquiring lock "cinder-quobyte-5099828b-ed0f-44d6-83b8-ca508f5dc489" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:52:17 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-64d5d6ed-1725-4406-83cc-09fa36d9e180 tempest-VolumesTransfersV355Test-258729424 None] Lock "cinder-quobyte-5099828b-ed0f-44d6-83b8-ca508f5dc489" acquired by "delete_volume" :: waited 0.015s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:52:17 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[910eb33d-d4dd-459d-a25d-33f8ea6b9716]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:52:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-64d5d6ed-1725-4406-83cc-09fa36d9e180 tempest-VolumesTransfersV355Test-258729424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5099828b-ed0f-44d6-83b8-ca508f5dc489 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:17 devstack sudo[87094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5099828b-ed0f-44d6-83b8-ca508f5dc489 Apr 25 15:52:17 devstack sudo[87094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:17 devstack sudo[87088]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-25e618d6-a784-4c6f-949a-be54a25b7f0f tempest-VolumesSnapshotListTestJSON-1273609158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b" returned: 0 in 0.603s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-25e618d6-a784-4c6f-949a-be54a25b7f0f tempest-VolumesSnapshotListTestJSON-1273609158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.60b6814d-2243-4a40-9385-ab9874f61651 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:17 devstack sudo[87101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.60b6814d-2243-4a40-9385-ab9874f61651 1G Apr 25 15:52:17 devstack sudo[87101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:18 devstack sudo[87094]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-64d5d6ed-1725-4406-83cc-09fa36d9e180 tempest-VolumesTransfersV355Test-258729424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5099828b-ed0f-44d6-83b8-ca508f5dc489" returned: 0 in 0.728s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-64d5d6ed-1725-4406-83cc-09fa36d9e180 tempest-VolumesTransfersV355Test-258729424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5099828b-ed0f-44d6-83b8-ca508f5dc489 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:18 devstack sudo[87128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5099828b-ed0f-44d6-83b8-ca508f5dc489 Apr 25 15:52:18 devstack sudo[87128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:18 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-16ee6d22-2de0-43d2-9059-dd6000369b3c tempest-VolumesGetTest-1958092712 None] Acquiring lock "cinder-a4efe836-11b6-4f98-ba89-ec37c738456b-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:52:18 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-16ee6d22-2de0-43d2-9059-dd6000369b3c tempest-VolumesGetTest-1958092712 None] Lock "cinder-a4efe836-11b6-4f98-ba89-ec37c738456b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:52:18 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-16ee6d22-2de0-43d2-9059-dd6000369b3c tempest-VolumesGetTest-1958092712 None] Acquiring lock "cinder-quobyte-a4efe836-11b6-4f98-ba89-ec37c738456b" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:52:18 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-16ee6d22-2de0-43d2-9059-dd6000369b3c tempest-VolumesGetTest-1958092712 None] Lock "cinder-quobyte-a4efe836-11b6-4f98-ba89-ec37c738456b" acquired by "delete_volume" :: waited 0.016s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:52:18 devstack sudo[87101]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-25e618d6-a784-4c6f-949a-be54a25b7f0f tempest-VolumesSnapshotListTestJSON-1273609158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.60b6814d-2243-4a40-9385-ab9874f61651 1G" returned: 0 in 0.839s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-25e618d6-a784-4c6f-949a-be54a25b7f0f tempest-VolumesSnapshotListTestJSON-1273609158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.60b6814d-2243-4a40-9385-ab9874f61651 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:18 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1e7bae-8a29-4653-8a23-1ecb65b2a6e1]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:52:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-16ee6d22-2de0-43d2-9059-dd6000369b3c tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a4efe836-11b6-4f98-ba89-ec37c738456b {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:18 devstack sudo[87137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.60b6814d-2243-4a40-9385-ab9874f61651 Apr 25 15:52:18 devstack sudo[87137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:18 devstack sudo[87141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a4efe836-11b6-4f98-ba89-ec37c738456b Apr 25 15:52:18 devstack sudo[87141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:19 devstack sudo[87128]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-64d5d6ed-1725-4406-83cc-09fa36d9e180 tempest-VolumesTransfersV355Test-258729424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5099828b-ed0f-44d6-83b8-ca508f5dc489" returned: 0 in 0.881s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:19 devstack sudo[87137]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-25e618d6-a784-4c6f-949a-be54a25b7f0f tempest-VolumesSnapshotListTestJSON-1273609158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.60b6814d-2243-4a40-9385-ab9874f61651" returned: 0 in 0.661s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:19 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-25e618d6-a784-4c6f-949a-be54a25b7f0f tempest-VolumesSnapshotListTestJSON-1273609158 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.60b6814d-2243-4a40-9385-ab9874f61651 is being set with open permissions: ugo+rw Apr 25 15:52:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-25e618d6-a784-4c6f-949a-be54a25b7f0f tempest-VolumesSnapshotListTestJSON-1273609158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.60b6814d-2243-4a40-9385-ab9874f61651 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:19 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-64d5d6ed-1725-4406-83cc-09fa36d9e180 tempest-VolumesTransfersV355Test-258729424 None] Lock "cinder-quobyte-5099828b-ed0f-44d6-83b8-ca508f5dc489" released by "delete_volume" :: held 1.694s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:52:19 devstack sudo[87152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.60b6814d-2243-4a40-9385-ab9874f61651 Apr 25 15:52:19 devstack sudo[87152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:19 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-64d5d6ed-1725-4406-83cc-09fa36d9e180 tempest-VolumesTransfersV355Test-258729424 None] Created reservations ['0809f39c-af7e-455c-8d30-a480d33e1104', 'bf80dfe0-c4d4-4534-b993-cbc43ca69d22', '1c47e837-f73e-4bfc-a07f-c7620e15e013', 'd34bf331-3c9c-496c-9c34-06d36b779134'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:52:19 devstack sudo[87141]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-16ee6d22-2de0-43d2-9059-dd6000369b3c tempest-VolumesGetTest-1958092712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a4efe836-11b6-4f98-ba89-ec37c738456b" returned: 0 in 0.977s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-16ee6d22-2de0-43d2-9059-dd6000369b3c tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a4efe836-11b6-4f98-ba89-ec37c738456b {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-64d5d6ed-1725-4406-83cc-09fa36d9e180 tempest-VolumesTransfersV355Test-258729424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:52:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-64d5d6ed-1725-4406-83cc-09fa36d9e180 tempest-VolumesTransfersV355Test-258729424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:52:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-64d5d6ed-1725-4406-83cc-09fa36d9e180 tempest-VolumesTransfersV355Test-258729424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:52:19 devstack sudo[87158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a4efe836-11b6-4f98-ba89-ec37c738456b Apr 25 15:52:19 devstack sudo[87158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-64d5d6ed-1725-4406-83cc-09fa36d9e180 tempest-VolumesTransfersV355Test-258729424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:52:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-64d5d6ed-1725-4406-83cc-09fa36d9e180 tempest-VolumesTransfersV355Test-258729424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-64d5d6ed-1725-4406-83cc-09fa36d9e180 tempest-VolumesTransfersV355Test-258729424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:19 devstack sudo[87160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:52:19 devstack sudo[87160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:20 devstack sudo[87152]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-25e618d6-a784-4c6f-949a-be54a25b7f0f tempest-VolumesSnapshotListTestJSON-1273609158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.60b6814d-2243-4a40-9385-ab9874f61651" returned: 0 in 0.981s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-25e618d6-a784-4c6f-949a-be54a25b7f0f tempest-VolumesSnapshotListTestJSON-1273609158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:20 devstack sudo[87158]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-16ee6d22-2de0-43d2-9059-dd6000369b3c tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a4efe836-11b6-4f98-ba89-ec37c738456b" returned: 0 in 0.748s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:20 devstack sudo[87165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.info Apr 25 15:52:20 devstack sudo[87165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:20 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-16ee6d22-2de0-43d2-9059-dd6000369b3c tempest-VolumesGetTest-1958092712 None] Lock "cinder-quobyte-a4efe836-11b6-4f98-ba89-ec37c738456b" released by "delete_volume" :: held 1.825s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:52:20 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:52:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] Flow 'volume_create_manager' (6061d750-91b2-466c-9edc-4ffd10233681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:52:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c278d2-9449-43bc-986c-e06b370a2fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c278d2-9449-43bc-986c-e06b370a2fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1246742142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2857b243-1295-4da1-93d1-791b3a92baeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e4e3ed189774e1fa8a0d48c188ed795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:20Z,use_quota=True,user_id='8acf629ab91547b2af8063271744afce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4decc988-dbe3-4cf6-8e85-66e42061577e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4decc988-dbe3-4cf6-8e85-66e42061577e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (964ee271-c3e0-4863-929d-3889299b89c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (964ee271-c3e0-4863-929d-3889299b89c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2857b243-1295-4da1-93d1-791b3a92baeb', 'volume_name': 'volume-2857b243-1295-4da1-93d1-791b3a92baeb', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfa55fc7-449c-43ac-9702-cb7c797bc8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfa55fc7-449c-43ac-9702-cb7c797bc8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb5643e-127a-4926-a861-2927d9ad0430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:20 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] Volume 2857b243-1295-4da1-93d1-791b3a92baeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2857b243-1295-4da1-93d1-791b3a92baeb', 'volume_size': 1} Apr 25 15:52:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:52:20 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-16ee6d22-2de0-43d2-9059-dd6000369b3c tempest-VolumesGetTest-1958092712 None] Created reservations ['1e48d914-122b-48ed-b760-9ebf5a608b81', 'b36095f9-1b02-428f-84f4-641f641267db', 'c7ee31c9-ec47-4769-b612-e0739c1ecc73', '2f41e65d-a30d-4a64-b49f-6084e143cbaf'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:52:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-16ee6d22-2de0-43d2-9059-dd6000369b3c tempest-VolumesGetTest-1958092712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:52:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-16ee6d22-2de0-43d2-9059-dd6000369b3c tempest-VolumesGetTest-1958092712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:52:20 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-16ee6d22-2de0-43d2-9059-dd6000369b3c tempest-VolumesGetTest-1958092712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:52:20 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-16ee6d22-2de0-43d2-9059-dd6000369b3c tempest-VolumesGetTest-1958092712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:52:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-16ee6d22-2de0-43d2-9059-dd6000369b3c tempest-VolumesGetTest-1958092712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-16ee6d22-2de0-43d2-9059-dd6000369b3c tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:20 devstack sudo[87167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:52:20 devstack sudo[87167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:21 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-91f20bf2-292a-42d6-83a5-0a750ac97914 tempest-VolumesGetTest-1958092712 None] Acquiring lock "cinder-72f1afe3-890a-49c6-a86c-c5c70f43d8e3-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:52:21 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-91f20bf2-292a-42d6-83a5-0a750ac97914 tempest-VolumesGetTest-1958092712 None] Lock "cinder-72f1afe3-890a-49c6-a86c-c5c70f43d8e3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:52:21 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-91f20bf2-292a-42d6-83a5-0a750ac97914 tempest-VolumesGetTest-1958092712 None] Acquiring lock "cinder-quobyte-72f1afe3-890a-49c6-a86c-c5c70f43d8e3" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:52:21 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-91f20bf2-292a-42d6-83a5-0a750ac97914 tempest-VolumesGetTest-1958092712 None] Lock "cinder-quobyte-72f1afe3-890a-49c6-a86c-c5c70f43d8e3" acquired by "delete_volume" :: waited 0.020s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:52:21 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[65cca580-7a45-44e8-8af5-25705db99675]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:52:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-91f20bf2-292a-42d6-83a5-0a750ac97914 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72f1afe3-890a-49c6-a86c-c5c70f43d8e3 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:21 devstack sudo[87160]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-64d5d6ed-1725-4406-83cc-09fa36d9e180 tempest-VolumesTransfersV355Test-258729424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 1.433s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:21 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-64d5d6ed-1725-4406-83cc-09fa36d9e180 tempest-VolumesTransfersV355Test-258729424 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:52:21 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-64d5d6ed-1725-4406-83cc-09fa36d9e180 tempest-VolumesTransfersV355Test-258729424 None] Deleted volume successfully. Apr 25 15:52:21 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-64d5d6ed-1725-4406-83cc-09fa36d9e180 tempest-VolumesTransfersV355Test-258729424 None] Lock "cinder-5099828b-ed0f-44d6-83b8-ca508f5dc489-delete_volume" released by "delete_volume" :: held 3.623s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:52:21 devstack sudo[87170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72f1afe3-890a-49c6-a86c-c5c70f43d8e3 Apr 25 15:52:21 devstack sudo[87170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:21 devstack sudo[87165]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-25e618d6-a784-4c6f-949a-be54a25b7f0f tempest-VolumesSnapshotListTestJSON-1273609158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.info" returned: 0 in 1.008s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:21 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-25e618d6-a784-4c6f-949a-be54a25b7f0f tempest-VolumesSnapshotListTestJSON-1273609158 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.info is being set with open permissions: ugo+rw Apr 25 15:52:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-25e618d6-a784-4c6f-949a-be54a25b7f0f tempest-VolumesSnapshotListTestJSON-1273609158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:21 devstack sudo[87174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.info Apr 25 15:52:21 devstack sudo[87174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:21 devstack sudo[87167]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-16ee6d22-2de0-43d2-9059-dd6000369b3c tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.982s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:21 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-16ee6d22-2de0-43d2-9059-dd6000369b3c tempest-VolumesGetTest-1958092712 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:52:21 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-16ee6d22-2de0-43d2-9059-dd6000369b3c tempest-VolumesGetTest-1958092712 None] Deleted volume successfully. Apr 25 15:52:21 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-16ee6d22-2de0-43d2-9059-dd6000369b3c tempest-VolumesGetTest-1958092712 None] Lock "cinder-a4efe836-11b6-4f98-ba89-ec37c738456b-delete_volume" released by "delete_volume" :: held 3.241s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:52:22 devstack sudo[87170]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] Flow 'volume_create_manager' (a9058f11-1968-4f1d-b540-2269625e25ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5eead6b-3c84-479c-a1e9-18a48f6bfea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-91f20bf2-292a-42d6-83a5-0a750ac97914 tempest-VolumesGetTest-1958092712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72f1afe3-890a-49c6-a86c-c5c70f43d8e3" returned: 0 in 0.980s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-91f20bf2-292a-42d6-83a5-0a750ac97914 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72f1afe3-890a-49c6-a86c-c5c70f43d8e3 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5eead6b-3c84-479c-a1e9-18a48f6bfea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-720606341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a45e8f5-ff6e-4ecd-9101-63e5ee7e1b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3a9e4c24d7b4da1ad9c5f64029897df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:22Z,use_quota=True,user_id='e70659bf1efe43b58e9393d0cfd7ba94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5d1f10f-89d3-4ac3-bd4c-0f7fdc3e6675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5d1f10f-89d3-4ac3-bd4c-0f7fdc3e6675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8336895d-8fd3-426e-816c-a520e760e7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8336895d-8fd3-426e-816c-a520e760e7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a45e8f5-ff6e-4ecd-9101-63e5ee7e1b13', 'volume_name': 'volume-0a45e8f5-ff6e-4ecd-9101-63e5ee7e1b13', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:22 devstack sudo[87181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72f1afe3-890a-49c6-a86c-c5c70f43d8e3 Apr 25 15:52:22 devstack sudo[87181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dbf2229-2a3e-44aa-a797-b53260377604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dbf2229-2a3e-44aa-a797-b53260377604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7669d58-322e-46fb-924b-a912de470356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:22 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] Volume 0a45e8f5-ff6e-4ecd-9101-63e5ee7e1b13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a45e8f5-ff6e-4ecd-9101-63e5ee7e1b13', 'volume_size': 1} Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:52:22 devstack sudo[87174]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-25e618d6-a784-4c6f-949a-be54a25b7f0f tempest-VolumesSnapshotListTestJSON-1273609158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.info" returned: 0 in 0.804s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-25e618d6-a784-4c6f-949a-be54a25b7f0f tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.073s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.639s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1246742142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2857b243-1295-4da1-93d1-791b3a92baeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e4e3ed189774e1fa8a0d48c188ed795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:20Z,use_quota=True,user_id='8acf629ab91547b2af8063271744afce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] Creating volume 2857b243-1295-4da1-93d1-791b3a92baeb {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:52:22 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2857b243-1295-4da1-93d1-791b3a92baeb 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:22 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-25e618d6-a784-4c6f-949a-be54a25b7f0f tempest-VolumesSnapshotListTestJSON-1273609158 None] Create snapshot completed successfully Apr 25 15:52:22 devstack sudo[87183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2857b243-1295-4da1-93d1-791b3a92baeb 1073741824 Apr 25 15:52:22 devstack sudo[87183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:22 devstack sudo[87181]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-91f20bf2-292a-42d6-83a5-0a750ac97914 tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72f1afe3-890a-49c6-a86c-c5c70f43d8e3" returned: 0 in 0.591s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-91f20bf2-292a-42d6-83a5-0a750ac97914 tempest-VolumesGetTest-1958092712 None] Lock "cinder-quobyte-72f1afe3-890a-49c6-a86c-c5c70f43d8e3" released by "delete_volume" :: held 1.621s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-91f20bf2-292a-42d6-83a5-0a750ac97914 tempest-VolumesGetTest-1958092712 None] Created reservations ['15007d6b-f596-4ae7-9300-3f93f3dde9b6', '962ad371-3201-41fa-9986-b6126b60bad9', '9cc53089-29d7-4ecf-8519-7401d6d2f151', 'db9050bb-e9d9-47f2-b1e0-aa29b1678f02'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-91f20bf2-292a-42d6-83a5-0a750ac97914 tempest-VolumesGetTest-1958092712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-91f20bf2-292a-42d6-83a5-0a750ac97914 tempest-VolumesGetTest-1958092712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-91f20bf2-292a-42d6-83a5-0a750ac97914 tempest-VolumesGetTest-1958092712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-91f20bf2-292a-42d6-83a5-0a750ac97914 tempest-VolumesGetTest-1958092712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-91f20bf2-292a-42d6-83a5-0a750ac97914 tempest-VolumesGetTest-1958092712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-91f20bf2-292a-42d6-83a5-0a750ac97914 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:22 devstack sudo[87189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:52:22 devstack sudo[87189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:22 devstack sudo[87183]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2857b243-1295-4da1-93d1-791b3a92baeb 1073741824" returned: 0 in 0.731s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2857b243-1295-4da1-93d1-791b3a92baeb {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:23 devstack sudo[87191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2857b243-1295-4da1-93d1-791b3a92baeb Apr 25 15:52:23 devstack sudo[87191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-abdf6eb6-63c0-452d-9151-709ca6f6bea5 tempest-VolumesSnapshotListTestJSON-1273609158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:52:23 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-0ff5fb54-b6fa-435b-9b91-c5c18e959a8f tempest-VolumesGetTest-1958092712 None] Acquiring lock "cinder-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:52:23 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-0ff5fb54-b6fa-435b-9b91-c5c18e959a8f tempest-VolumesGetTest-1958092712 None] Lock "cinder-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:52:23 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-0ff5fb54-b6fa-435b-9b91-c5c18e959a8f tempest-VolumesGetTest-1958092712 None] Acquiring lock "cinder-quobyte-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:52:23 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-0ff5fb54-b6fa-435b-9b91-c5c18e959a8f tempest-VolumesGetTest-1958092712 None] Lock "cinder-quobyte-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab" acquired by "delete_volume" :: waited 0.013s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:52:23 devstack sudo[87189]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-91f20bf2-292a-42d6-83a5-0a750ac97914 tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.613s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:23 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-91f20bf2-292a-42d6-83a5-0a750ac97914 tempest-VolumesGetTest-1958092712 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:52:23 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[86361cd2-8b7b-4819-993e-a22cba85b59a]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:52:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0ff5fb54-b6fa-435b-9b91-c5c18e959a8f tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:23 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-91f20bf2-292a-42d6-83a5-0a750ac97914 tempest-VolumesGetTest-1958092712 None] Deleted volume successfully. Apr 25 15:52:23 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-91f20bf2-292a-42d6-83a5-0a750ac97914 tempest-VolumesGetTest-1958092712 None] Lock "cinder-72f1afe3-890a-49c6-a86c-c5c70f43d8e3-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:52:23 devstack sudo[87191]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2857b243-1295-4da1-93d1-791b3a92baeb" returned: 0 in 0.601s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:23 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:52:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.382s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:23 devstack sudo[87194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab Apr 25 15:52:23 devstack sudo[87194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.428s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:52:23 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-720606341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a45e8f5-ff6e-4ecd-9101-63e5ee7e1b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3a9e4c24d7b4da1ad9c5f64029897df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:22Z,use_quota=True,user_id='e70659bf1efe43b58e9393d0cfd7ba94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:52:23 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] Creating volume 0a45e8f5-ff6e-4ecd-9101-63e5ee7e1b13 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:52:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:52:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:52:23 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:52:23 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:52:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:23 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:52:23 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:52:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0a45e8f5-ff6e-4ecd-9101-63e5ee7e1b13 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:23 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb5643e-127a-4926-a861-2927d9ad0430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2857b243-1295-4da1-93d1-791b3a92baeb', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:23 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9d62795-c55e-49dd-8f9a-2491ae3e5d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:23 devstack sudo[87197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0a45e8f5-ff6e-4ecd-9101-63e5ee7e1b13 1073741824 Apr 25 15:52:23 devstack sudo[87197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:23 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] Volume volume-2857b243-1295-4da1-93d1-791b3a92baeb (2857b243-1295-4da1-93d1-791b3a92baeb): created successfully Apr 25 15:52:23 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9d62795-c55e-49dd-8f9a-2491ae3e5d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:23 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] Flow 'volume_create_manager' (6061d750-91b2-466c-9edc-4ffd10233681) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:52:23 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-6ecba916-59be-4e6a-b8d3-1dffe3e56e8d tempest-VolumesTransfersV355Test-39770509 None] Created volume successfully. Apr 25 15:52:24 devstack sudo[87194]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0ff5fb54-b6fa-435b-9b91-c5c18e959a8f tempest-VolumesGetTest-1958092712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab" returned: 0 in 0.745s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0ff5fb54-b6fa-435b-9b91-c5c18e959a8f tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:24 devstack sudo[87205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab Apr 25 15:52:24 devstack sudo[87205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:24 devstack sudo[87197]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0a45e8f5-ff6e-4ecd-9101-63e5ee7e1b13 1073741824" returned: 0 in 0.711s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0a45e8f5-ff6e-4ecd-9101-63e5ee7e1b13 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:24 devstack sudo[87207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0a45e8f5-ff6e-4ecd-9101-63e5ee7e1b13 Apr 25 15:52:24 devstack sudo[87207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:24 devstack sudo[87205]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0ff5fb54-b6fa-435b-9b91-c5c18e959a8f tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab" returned: 0 in 0.574s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:24 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-0ff5fb54-b6fa-435b-9b91-c5c18e959a8f tempest-VolumesGetTest-1958092712 None] Lock "cinder-quobyte-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab" released by "delete_volume" :: held 1.380s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:52:24 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-0ff5fb54-b6fa-435b-9b91-c5c18e959a8f tempest-VolumesGetTest-1958092712 None] Created reservations ['29e93245-727e-49e5-8cba-a1c367d455ed', 'ab7f4398-edac-4f60-b823-d57dc9fefaac', '6e5e24e1-4d84-4f13-b39f-7e606a816f20', '7902a681-d824-4bfa-9a5c-4f1df26991c6'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:52:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0ff5fb54-b6fa-435b-9b91-c5c18e959a8f tempest-VolumesGetTest-1958092712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:52:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0ff5fb54-b6fa-435b-9b91-c5c18e959a8f tempest-VolumesGetTest-1958092712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:52:25 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-0ff5fb54-b6fa-435b-9b91-c5c18e959a8f tempest-VolumesGetTest-1958092712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:52:25 devstack sudo[87207]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:25 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-0ff5fb54-b6fa-435b-9b91-c5c18e959a8f tempest-VolumesGetTest-1958092712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:52:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0ff5fb54-b6fa-435b-9b91-c5c18e959a8f tempest-VolumesGetTest-1958092712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0ff5fb54-b6fa-435b-9b91-c5c18e959a8f tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0a45e8f5-ff6e-4ecd-9101-63e5ee7e1b13" returned: 0 in 0.644s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:25 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:52:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.397s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-abdf6eb6-63c0-452d-9151-709ca6f6bea5 tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.941s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:52:25 devstack sudo[87212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:52:25 devstack sudo[87212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7669d58-322e-46fb-924b-a912de470356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a45e8f5-ff6e-4ecd-9101-63e5ee7e1b13', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b511ea1f-139f-40a3-88fa-e7d690595c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:25 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-abdf6eb6-63c0-452d-9151-709ca6f6bea5 tempest-VolumesSnapshotListTestJSON-1273609158 None] Creating offline snapshot 6572d524-6a29-4df8-89d9-4410fbea2302 of volume ef032f44-f40e-4e02-860c-d4b3d377fc8b {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 15:52:25 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] Volume volume-0a45e8f5-ff6e-4ecd-9101-63e5ee7e1b13 (0a45e8f5-ff6e-4ecd-9101-63e5ee7e1b13): created successfully Apr 25 15:52:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b511ea1f-139f-40a3-88fa-e7d690595c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] Flow 'volume_create_manager' (a9058f11-1968-4f1d-b540-2269625e25ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:52:25 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2b14f1-c1a7-4cb4-9aa3-1a5786bca371]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:52:25 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-86c322ec-7f69-4f4e-9c0b-b41f08f6ef8a tempest-VolumesTransfersV355Test-258729424 None] Acquiring lock "cinder-2857b243-1295-4da1-93d1-791b3a92baeb-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:52:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-abdf6eb6-63c0-452d-9151-709ca6f6bea5 tempest-VolumesSnapshotListTestJSON-1273609158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.60b6814d-2243-4a40-9385-ab9874f61651 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:25 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-86c322ec-7f69-4f4e-9c0b-b41f08f6ef8a tempest-VolumesTransfersV355Test-258729424 None] Lock "cinder-2857b243-1295-4da1-93d1-791b3a92baeb-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:52:25 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-407f2be2-f70e-4f98-8fb5-544824a6cf2c tempest-ServerRescueNegativeTestJSON-1935342506 None] Created volume successfully. Apr 25 15:52:25 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-86c322ec-7f69-4f4e-9c0b-b41f08f6ef8a tempest-VolumesTransfersV355Test-258729424 None] Acquiring lock "cinder-quobyte-2857b243-1295-4da1-93d1-791b3a92baeb" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:52:25 devstack sudo[87214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.60b6814d-2243-4a40-9385-ab9874f61651 Apr 25 15:52:25 devstack sudo[87214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:25 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-86c322ec-7f69-4f4e-9c0b-b41f08f6ef8a tempest-VolumesTransfersV355Test-258729424 None] Lock "cinder-quobyte-2857b243-1295-4da1-93d1-791b3a92baeb" acquired by "delete_volume" :: waited 0.018s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:52:25 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b34a33d-12a0-455b-a3d7-9d4eff3f7106]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:52:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-86c322ec-7f69-4f4e-9c0b-b41f08f6ef8a tempest-VolumesTransfersV355Test-258729424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2857b243-1295-4da1-93d1-791b3a92baeb {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:25 devstack sudo[87216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2857b243-1295-4da1-93d1-791b3a92baeb Apr 25 15:52:25 devstack sudo[87216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:26 devstack sudo[87212]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0ff5fb54-b6fa-435b-9b91-c5c18e959a8f tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 1.272s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:26 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-0ff5fb54-b6fa-435b-9b91-c5c18e959a8f tempest-VolumesGetTest-1958092712 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:52:26 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-0ff5fb54-b6fa-435b-9b91-c5c18e959a8f tempest-VolumesGetTest-1958092712 None] Deleted volume successfully. Apr 25 15:52:26 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-0ff5fb54-b6fa-435b-9b91-c5c18e959a8f tempest-VolumesGetTest-1958092712 None] Lock "cinder-0ddb6a01-6322-4c50-9ebe-57c85d6c75ab-delete_volume" released by "delete_volume" :: held 2.948s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:52:26 devstack sudo[87214]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-abdf6eb6-63c0-452d-9151-709ca6f6bea5 tempest-VolumesSnapshotListTestJSON-1273609158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.60b6814d-2243-4a40-9385-ab9874f61651" returned: 0 in 1.471s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:26 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-abdf6eb6-63c0-452d-9151-709ca6f6bea5 tempest-VolumesSnapshotListTestJSON-1273609158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:52:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-abdf6eb6-63c0-452d-9151-709ca6f6bea5 tempest-VolumesSnapshotListTestJSON-1273609158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.60b6814d-2243-4a40-9385-ab9874f61651,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.6572d524-6a29-4df8-89d9-4410fbea2302 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:26 devstack sudo[87239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.60b6814d-2243-4a40-9385-ab9874f61651,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.6572d524-6a29-4df8-89d9-4410fbea2302 1G Apr 25 15:52:26 devstack sudo[87239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:26 devstack sudo[87216]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:26 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:52:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Flow 'volume_create_manager' (bec83392-4f38-4de1-8215-d3b0e82b04d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:52:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3e54ea-c825-457d-a306-185b32d63642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-86c322ec-7f69-4f4e-9c0b-b41f08f6ef8a tempest-VolumesTransfersV355Test-258729424 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2857b243-1295-4da1-93d1-791b3a92baeb" returned: 0 in 1.430s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-86c322ec-7f69-4f4e-9c0b-b41f08f6ef8a tempest-VolumesTransfersV355Test-258729424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2857b243-1295-4da1-93d1-791b3a92baeb {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3e54ea-c825-457d-a306-185b32d63642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-812493186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99c55c33-6c09-418b-b814-11e31429660e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f26d321e4fad403f96fc2464beedf804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:27Z,use_quota=True,user_id='da38bf8530894933a3fb58a1909c22c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (615db043-9798-4746-adb4-7667ed2d502e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:26 devstack sudo[87244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2857b243-1295-4da1-93d1-791b3a92baeb Apr 25 15:52:26 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (615db043-9798-4746-adb4-7667ed2d502e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d4d76a6-5028-4b7e-ac64-772b0ba9129c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:26 devstack cinder-volume[81828]: DEBUG cinder.image.glance [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Creating Keystone auth plugin from conf {{(pid=81828) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 25 15:52:27 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-86c322ec-7f69-4f4e-9c0b-b41f08f6ef8a tempest-VolumesTransfersV355Test-258729424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2857b243-1295-4da1-93d1-791b3a92baeb" returned: 0 in 0.832s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:27 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d4d76a6-5028-4b7e-ac64-772b0ba9129c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '99c55c33-6c09-418b-b814-11e31429660e', 'volume_name': 'volume-99c55c33-6c09-418b-b814-11e31429660e', 'volume_size': 1, 'image_id': '4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99560f74c63f4b9285294e59133188d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'created_at': datetime.datetime(2026, 4, 25, 13, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 13, 42, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:27 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c45e547-8769-4419-a533-8be81ca8106c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:27 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c45e547-8769-4419-a533-8be81ca8106c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:27 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759ba67f-af6a-49cb-b326-0349020db2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:27 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Volume 99c55c33-6c09-418b-b814-11e31429660e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-99c55c33-6c09-418b-b814-11e31429660e', 'volume_size': 1, 'image_id': '4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99560f74c63f4b9285294e59133188d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'created_at': datetime.datetime(2026, 4, 25, 13, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 13, 42, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 25 15:52:27 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Trying to clone 99c55c33-6c09-418b-b814-11e31429660e from image 4a29fc86-7ce4-447e-98ea-c141a6c39b3d at location (None, [{'url': 'file:///opt/stack/data/glance/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'metadata': {}}]). {{(pid=81828) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 25 15:52:27 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-86c322ec-7f69-4f4e-9c0b-b41f08f6ef8a tempest-VolumesTransfersV355Test-258729424 None] Lock "cinder-quobyte-2857b243-1295-4da1-93d1-791b3a92baeb" released by "delete_volume" :: held 2.346s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:52:27 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-86c322ec-7f69-4f4e-9c0b-b41f08f6ef8a tempest-VolumesTransfersV355Test-258729424 None] Created reservations ['4c76551f-0999-4a2f-8317-bdf4f50fe983', '75e76560-4667-4a42-9a07-6221c648c7b2', '8ae014d9-8f29-4af4-8d2a-6702b58b441b', 'd38006fc-018c-4f66-ad1f-dadd32f611db'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:52:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-86c322ec-7f69-4f4e-9c0b-b41f08f6ef8a tempest-VolumesTransfersV355Test-258729424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:52:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-86c322ec-7f69-4f4e-9c0b-b41f08f6ef8a tempest-VolumesTransfersV355Test-258729424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:52:27 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-86c322ec-7f69-4f4e-9c0b-b41f08f6ef8a tempest-VolumesTransfersV355Test-258729424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:52:27 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-86c322ec-7f69-4f4e-9c0b-b41f08f6ef8a tempest-VolumesTransfersV355Test-258729424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:52:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-86c322ec-7f69-4f4e-9c0b-b41f08f6ef8a tempest-VolumesTransfersV355Test-258729424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-86c322ec-7f69-4f4e-9c0b-b41f08f6ef8a tempest-VolumesTransfersV355Test-258729424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:28 devstack sudo[87253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:52:28 devstack sudo[87253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:28 devstack sudo[87239]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-abdf6eb6-63c0-452d-9151-709ca6f6bea5 tempest-VolumesSnapshotListTestJSON-1273609158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.60b6814d-2243-4a40-9385-ab9874f61651,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.6572d524-6a29-4df8-89d9-4410fbea2302 1G" returned: 0 in 1.574s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-abdf6eb6-63c0-452d-9151-709ca6f6bea5 tempest-VolumesSnapshotListTestJSON-1273609158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.60b6814d-2243-4a40-9385-ab9874f61651 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.6572d524-6a29-4df8-89d9-4410fbea2302 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:28 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_8gnlcj0pdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81828) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 25 15:52:28 devstack cinder-volume[81828]: INFO cinder.image.image_utils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Image download 20.69 MB at 20.69 MB/s Apr 25 15:52:28 devstack sudo[87256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.60b6814d-2243-4a40-9385-ab9874f61651 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.6572d524-6a29-4df8-89d9-4410fbea2302 Apr 25 15:52:28 devstack sudo[87256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:28 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccd38e9-8ebf-494b-968e-3be2182b98cf]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:52:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_8gnlcj0pdevstack@QuobyteHD {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:28 devstack sudo[87258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_8gnlcj0pdevstack@QuobyteHD Apr 25 15:52:28 devstack sudo[87258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:28 devstack sudo[87253]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-86c322ec-7f69-4f4e-9c0b-b41f08f6ef8a tempest-VolumesTransfersV355Test-258729424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.700s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:28 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-86c322ec-7f69-4f4e-9c0b-b41f08f6ef8a tempest-VolumesTransfersV355Test-258729424 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:52:28 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-86c322ec-7f69-4f4e-9c0b-b41f08f6ef8a tempest-VolumesTransfersV355Test-258729424 None] Deleted volume successfully. Apr 25 15:52:28 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-86c322ec-7f69-4f4e-9c0b-b41f08f6ef8a tempest-VolumesTransfersV355Test-258729424 None] Lock "cinder-2857b243-1295-4da1-93d1-791b3a92baeb-delete_volume" released by "delete_volume" :: held 3.424s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:52:28 devstack sudo[87258]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_8gnlcj0pdevstack@QuobyteHD" returned: 0 in 0.660s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:28 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Temporary image 4a29fc86-7ce4-447e-98ea-c141a6c39b3d is fetched for user da38bf8530894933a3fb58a1909c22c0. {{(pid=81828) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 25 15:52:29 devstack sudo[87256]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-abdf6eb6-63c0-452d-9151-709ca6f6bea5 tempest-VolumesSnapshotListTestJSON-1273609158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.60b6814d-2243-4a40-9385-ab9874f61651 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.6572d524-6a29-4df8-89d9-4410fbea2302" returned: 0 in 0.754s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:29 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-abdf6eb6-63c0-452d-9151-709ca6f6bea5 tempest-VolumesSnapshotListTestJSON-1273609158 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.6572d524-6a29-4df8-89d9-4410fbea2302 is being set with open permissions: ugo+rw Apr 25 15:52:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-abdf6eb6-63c0-452d-9151-709ca6f6bea5 tempest-VolumesSnapshotListTestJSON-1273609158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.6572d524-6a29-4df8-89d9-4410fbea2302 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:29 devstack sudo[87267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.6572d524-6a29-4df8-89d9-4410fbea2302 Apr 25 15:52:29 devstack sudo[87267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:29 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea98da48-c204-49cf-a13e-2c5e55312b57]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:52:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_8gnlcj0pdevstack@QuobyteHD {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:29 devstack sudo[87269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_8gnlcj0pdevstack@QuobyteHD Apr 25 15:52:29 devstack sudo[87269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:29 devstack sudo[87267]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-abdf6eb6-63c0-452d-9151-709ca6f6bea5 tempest-VolumesSnapshotListTestJSON-1273609158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.6572d524-6a29-4df8-89d9-4410fbea2302" returned: 0 in 0.677s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-abdf6eb6-63c0-452d-9151-709ca6f6bea5 tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.736s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:29 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-abdf6eb6-63c0-452d-9151-709ca6f6bea5 tempest-VolumesSnapshotListTestJSON-1273609158 None] Create snapshot completed successfully Apr 25 15:52:30 devstack sudo[87269]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_8gnlcj0pdevstack@QuobyteHD" returned: 0 in 1.167s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:52:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:52:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-812493186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99c55c33-6c09-418b-b814-11e31429660e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f26d321e4fad403f96fc2464beedf804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:27Z,use_quota=True,user_id='da38bf8530894933a3fb58a1909c22c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:52:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Creating volume 99c55c33-6c09-418b-b814-11e31429660e {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:52:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:52:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:52:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:52:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:52:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:52:30 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:52:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99c55c33-6c09-418b-b814-11e31429660e 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:30 devstack sudo[87298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99c55c33-6c09-418b-b814-11e31429660e 1073741824 Apr 25 15:52:30 devstack sudo[87298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ab21b448-51b9-435b-bbc0-e7f38f5ddf2b tempest-VolumesSnapshotListTestJSON-1273609158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:52:31 devstack sudo[87298]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99c55c33-6c09-418b-b814-11e31429660e 1073741824" returned: 0 in 1.060s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99c55c33-6c09-418b-b814-11e31429660e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:31 devstack sudo[87311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99c55c33-6c09-418b-b814-11e31429660e Apr 25 15:52:31 devstack sudo[87311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:31 devstack sudo[87311]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99c55c33-6c09-418b-b814-11e31429660e" returned: 0 in 0.621s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:32 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:52:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ab21b448-51b9-435b-bbc0-e7f38f5ddf2b tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.025s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:52:32 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-ab21b448-51b9-435b-bbc0-e7f38f5ddf2b tempest-VolumesSnapshotListTestJSON-1273609158 None] Creating offline snapshot 1ded605a-c024-4ecd-b224-858881ccdfda of volume ef032f44-f40e-4e02-860c-d4b3d377fc8b {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 15:52:32 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c732fe0-c1d2-4ddb-a1d7-f4f5024736f1]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:52:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ab21b448-51b9-435b-bbc0-e7f38f5ddf2b tempest-VolumesSnapshotListTestJSON-1273609158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.6572d524-6a29-4df8-89d9-4410fbea2302 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:32 devstack cinder-volume[81828]: DEBUG cinder.volume.volume_utils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Attempting download of 4a29fc86-7ce4-447e-98ea-c141a6c39b3d ((None, [{'url': 'file:///opt/stack/data/glance/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'metadata': {}}])) to volume 99c55c33-6c09-418b-b814-11e31429660e. {{(pid=81828) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 25 15:52:32 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dcbede1-d2ed-4bbe-aeaa-94aaf31b85f9]: (4, 'raw') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:52:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_5tsezquw {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:32 devstack sudo[87338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.6572d524-6a29-4df8-89d9-4410fbea2302 Apr 25 15:52:32 devstack sudo[87338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:32 devstack sudo[87339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_5tsezquw Apr 25 15:52:32 devstack sudo[87339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:32 devstack sudo[87338]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ab21b448-51b9-435b-bbc0-e7f38f5ddf2b tempest-VolumesSnapshotListTestJSON-1273609158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.6572d524-6a29-4df8-89d9-4410fbea2302" returned: 0 in 0.685s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:32 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-ab21b448-51b9-435b-bbc0-e7f38f5ddf2b tempest-VolumesSnapshotListTestJSON-1273609158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:52:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ab21b448-51b9-435b-bbc0-e7f38f5ddf2b tempest-VolumesSnapshotListTestJSON-1273609158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.6572d524-6a29-4df8-89d9-4410fbea2302,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.1ded605a-c024-4ecd-b224-858881ccdfda 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:32 devstack sudo[87347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.6572d524-6a29-4df8-89d9-4410fbea2302,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.1ded605a-c024-4ecd-b224-858881ccdfda 1G Apr 25 15:52:32 devstack sudo[87347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:32 devstack sudo[87339]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_5tsezquw" returned: 0 in 0.649s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_5tsezquw {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:33 devstack sudo[87349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_5tsezquw Apr 25 15:52:33 devstack sudo[87349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:33 devstack sudo[87349]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_5tsezquw" returned: 1 in 0.789s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_5tsezquw' failed. Not Retrying. {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 25 15:52:33 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9406b7-61a6-4a82-8a87-f3b0a91742be]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:52:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_8gnlcj0pdevstack@QuobyteHD {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:33 devstack sudo[87347]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ab21b448-51b9-435b-bbc0-e7f38f5ddf2b tempest-VolumesSnapshotListTestJSON-1273609158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.6572d524-6a29-4df8-89d9-4410fbea2302,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.1ded605a-c024-4ecd-b224-858881ccdfda 1G" returned: 0 in 0.868s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ab21b448-51b9-435b-bbc0-e7f38f5ddf2b tempest-VolumesSnapshotListTestJSON-1273609158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.6572d524-6a29-4df8-89d9-4410fbea2302 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.1ded605a-c024-4ecd-b224-858881ccdfda {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:33 devstack sudo[87359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.6572d524-6a29-4df8-89d9-4410fbea2302 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.1ded605a-c024-4ecd-b224-858881ccdfda Apr 25 15:52:33 devstack sudo[87359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:33 devstack sudo[87358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_8gnlcj0pdevstack@QuobyteHD Apr 25 15:52:33 devstack sudo[87358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:34 devstack sudo[87359]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ab21b448-51b9-435b-bbc0-e7f38f5ddf2b tempest-VolumesSnapshotListTestJSON-1273609158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.6572d524-6a29-4df8-89d9-4410fbea2302 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.1ded605a-c024-4ecd-b224-858881ccdfda" returned: 0 in 0.537s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:34 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-ab21b448-51b9-435b-bbc0-e7f38f5ddf2b tempest-VolumesSnapshotListTestJSON-1273609158 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.1ded605a-c024-4ecd-b224-858881ccdfda is being set with open permissions: ugo+rw Apr 25 15:52:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ab21b448-51b9-435b-bbc0-e7f38f5ddf2b tempest-VolumesSnapshotListTestJSON-1273609158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.1ded605a-c024-4ecd-b224-858881ccdfda {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:34 devstack sudo[87358]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_8gnlcj0pdevstack@QuobyteHD" returned: 0 in 0.568s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:34 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] 4a29fc86-7ce4-447e-98ea-c141a6c39b3d was qcow2, converting to raw {{(pid=81828) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 25 15:52:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_8gnlcj0pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99c55c33-6c09-418b-b814-11e31429660e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:34 devstack sudo[87368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.1ded605a-c024-4ecd-b224-858881ccdfda Apr 25 15:52:34 devstack sudo[87368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:34 devstack sudo[87369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_8gnlcj0pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99c55c33-6c09-418b-b814-11e31429660e Apr 25 15:52:34 devstack sudo[87369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:34 devstack sudo[87368]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ab21b448-51b9-435b-bbc0-e7f38f5ddf2b tempest-VolumesSnapshotListTestJSON-1273609158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.1ded605a-c024-4ecd-b224-858881ccdfda" returned: 0 in 0.460s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ab21b448-51b9-435b-bbc0-e7f38f5ddf2b tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.690s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:34 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-ab21b448-51b9-435b-bbc0-e7f38f5ddf2b tempest-VolumesSnapshotListTestJSON-1273609158 None] Create snapshot completed successfully Apr 25 15:52:36 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-58de14ad-60e1-483d-9671-cdb4af9382d4 tempest-VolumesSnapshotListTestJSON-1273609158 None] Acquiring lock "cinder-1ded605a-c024-4ecd-b224-858881ccdfda-delete_snapshot" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:52:36 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-58de14ad-60e1-483d-9671-cdb4af9382d4 tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "cinder-1ded605a-c024-4ecd-b224-858881ccdfda-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:52:36 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-58de14ad-60e1-483d-9671-cdb4af9382d4 tempest-VolumesSnapshotListTestJSON-1273609158 None] Acquiring lock "cinder-quobyte-ef032f44-f40e-4e02-860c-d4b3d377fc8b" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:52:36 devstack sudo[87369]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_8gnlcj0pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99c55c33-6c09-418b-b814-11e31429660e" returned: 0 in 1.869s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:36 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_8gnlcj0pdevstack@QuobyteHD, size 112.00 MB, duration 1.87 sec, destination /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99c55c33-6c09-418b-b814-11e31429660e {{(pid=81828) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 15:52:36 devstack cinder-volume[81828]: INFO cinder.image.image_utils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Converted 112.00 MB image at 59.90 MB/s Apr 25 15:52:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99c55c33-6c09-418b-b814-11e31429660e 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:36 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-58de14ad-60e1-483d-9671-cdb4af9382d4 tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "cinder-quobyte-ef032f44-f40e-4e02-860c-d4b3d377fc8b" acquired by "delete_snapshot" :: waited 0.040s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:52:36 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-58de14ad-60e1-483d-9671-cdb4af9382d4 tempest-VolumesSnapshotListTestJSON-1273609158 None] Acquiring lock "cinder-quobyte-1ded605a-c024-4ecd-b224-858881ccdfda" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:52:36 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-58de14ad-60e1-483d-9671-cdb4af9382d4 tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "cinder-quobyte-1ded605a-c024-4ecd-b224-858881ccdfda" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:52:36 devstack sudo[87390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99c55c33-6c09-418b-b814-11e31429660e 1G Apr 25 15:52:36 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-58de14ad-60e1-483d-9671-cdb4af9382d4 tempest-VolumesSnapshotListTestJSON-1273609158 None] Deleting offline snapshot 1ded605a-c024-4ecd-b224-858881ccdfda of volume ef032f44-f40e-4e02-860c-d4b3d377fc8b {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 15:52:36 devstack sudo[87390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:36 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-58de14ad-60e1-483d-9671-cdb4af9382d4 tempest-VolumesSnapshotListTestJSON-1273609158 None] snapshot_file for this snap is: volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.1ded605a-c024-4ecd-b224-858881ccdfda {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 15:52:36 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[565080ff-9f2a-4826-bc63-c9c658e60628]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:52:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-58de14ad-60e1-483d-9671-cdb4af9382d4 tempest-VolumesSnapshotListTestJSON-1273609158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.1ded605a-c024-4ecd-b224-858881ccdfda {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:36 devstack sudo[87392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.1ded605a-c024-4ecd-b224-858881ccdfda Apr 25 15:52:36 devstack sudo[87392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:36 devstack sudo[87392]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-58de14ad-60e1-483d-9671-cdb4af9382d4 tempest-VolumesSnapshotListTestJSON-1273609158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.1ded605a-c024-4ecd-b224-858881ccdfda" returned: 0 in 0.673s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:36 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-58de14ad-60e1-483d-9671-cdb4af9382d4 tempest-VolumesSnapshotListTestJSON-1273609158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:52:36 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b5c74c-c18d-4036-8122-96eba28d0590]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:52:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-58de14ad-60e1-483d-9671-cdb4af9382d4 tempest-VolumesSnapshotListTestJSON-1273609158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.6572d524-6a29-4df8-89d9-4410fbea2302 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:36 devstack sudo[87390]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99c55c33-6c09-418b-b814-11e31429660e 1G" returned: 0 in 0.821s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:36 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf08e20-2d2c-4835-bc32-1e6237a0d6b0]: (4, 'raw') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:52:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99c55c33-6c09-418b-b814-11e31429660e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:37 devstack sudo[87421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.6572d524-6a29-4df8-89d9-4410fbea2302 Apr 25 15:52:37 devstack sudo[87421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:37 devstack sudo[87426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99c55c33-6c09-418b-b814-11e31429660e Apr 25 15:52:37 devstack sudo[87426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:37 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:52:37 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] Flow 'volume_create_manager' (99b42bc0-22c3-4d81-8265-bfe477aeab6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:52:37 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (507dc2fc-500c-4b5e-9112-3b72c6a8d5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:37 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (507dc2fc-500c-4b5e-9112-3b72c6a8d5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-810574178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a3a17d2-da65-4896-8dc3-d46a8e6e8545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15ac06cfc3a847eabe679a89633d723e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:38Z,use_quota=True,user_id='df389e37a57345eb8ef83b6cd237826e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:37 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93476a9d-f00a-4aa8-bdc4-788d57a31903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:37 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93476a9d-f00a-4aa8-bdc4-788d57a31903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:37 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a8c5f7b-e29a-406d-8b5a-76af5c97f715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:37 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a8c5f7b-e29a-406d-8b5a-76af5c97f715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a3a17d2-da65-4896-8dc3-d46a8e6e8545', 'volume_name': 'volume-2a3a17d2-da65-4896-8dc3-d46a8e6e8545', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:37 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf11ca0-5620-4f12-a585-482af0b24a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:37 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcf11ca0-5620-4f12-a585-482af0b24a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:37 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee10cde4-de4d-4b94-9d00-87222ff91c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:37 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] Volume 2a3a17d2-da65-4896-8dc3-d46a8e6e8545: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a3a17d2-da65-4896-8dc3-d46a8e6e8545', 'volume_size': 1} Apr 25 15:52:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:52:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:52:37 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-810574178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a3a17d2-da65-4896-8dc3-d46a8e6e8545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15ac06cfc3a847eabe679a89633d723e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:38Z,use_quota=True,user_id='df389e37a57345eb8ef83b6cd237826e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:52:37 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] Creating volume 2a3a17d2-da65-4896-8dc3-d46a8e6e8545 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:52:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:52:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:52:37 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:52:37 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:52:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:37 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:52:37 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:52:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2a3a17d2-da65-4896-8dc3-d46a8e6e8545 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:37 devstack sudo[87444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2a3a17d2-da65-4896-8dc3-d46a8e6e8545 1073741824 Apr 25 15:52:37 devstack sudo[87444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:37 devstack sudo[87421]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-58de14ad-60e1-483d-9671-cdb4af9382d4 tempest-VolumesSnapshotListTestJSON-1273609158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.6572d524-6a29-4df8-89d9-4410fbea2302" returned: 0 in 1.079s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:37 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-58de14ad-60e1-483d-9671-cdb4af9382d4 tempest-VolumesSnapshotListTestJSON-1273609158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:52:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-58de14ad-60e1-483d-9671-cdb4af9382d4 tempest-VolumesSnapshotListTestJSON-1273609158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.1ded605a-c024-4ecd-b224-858881ccdfda {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:38 devstack sudo[87447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.1ded605a-c024-4ecd-b224-858881ccdfda Apr 25 15:52:38 devstack sudo[87447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:38 devstack sudo[87426]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99c55c33-6c09-418b-b814-11e31429660e" returned: 0 in 1.189s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99c55c33-6c09-418b-b814-11e31429660e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:38 devstack sudo[87451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99c55c33-6c09-418b-b814-11e31429660e Apr 25 15:52:38 devstack sudo[87451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:38 devstack sudo[87444]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2a3a17d2-da65-4896-8dc3-d46a8e6e8545 1073741824" returned: 0 in 0.921s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2a3a17d2-da65-4896-8dc3-d46a8e6e8545 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:38 devstack sudo[87459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2a3a17d2-da65-4896-8dc3-d46a8e6e8545 Apr 25 15:52:38 devstack sudo[87459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:39 devstack sudo[87447]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-58de14ad-60e1-483d-9671-cdb4af9382d4 tempest-VolumesSnapshotListTestJSON-1273609158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.1ded605a-c024-4ecd-b224-858881ccdfda" returned: 0 in 1.039s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-58de14ad-60e1-483d-9671-cdb4af9382d4 tempest-VolumesSnapshotListTestJSON-1273609158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.1ded605a-c024-4ecd-b224-858881ccdfda {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:39 devstack sudo[87465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.1ded605a-c024-4ecd-b224-858881ccdfda Apr 25 15:52:39 devstack sudo[87465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:39 devstack sudo[87451]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99c55c33-6c09-418b-b814-11e31429660e" returned: 1 in 1.000s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99c55c33-6c09-418b-b814-11e31429660e' failed. Not Retrying. {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 25 15:52:39 devstack cinder-volume[81828]: DEBUG cinder.volume.volume_utils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Downloaded image 4a29fc86-7ce4-447e-98ea-c141a6c39b3d ((None, [{'url': 'file:///opt/stack/data/glance/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'metadata': {}}])) to volume 99c55c33-6c09-418b-b814-11e31429660e successfully. {{(pid=81828) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 25 15:52:39 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Temporary image 4a29fc86-7ce4-447e-98ea-c141a6c39b3d for user da38bf8530894933a3fb58a1909c22c0 is deleted. {{(pid=81828) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 25 15:52:39 devstack cinder-volume[81828]: DEBUG cinder.volume.volume_utils [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Marking volume 99c55c33-6c09-418b-b814-11e31429660e as bootable. {{(pid=81828) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 25 15:52:39 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Copying metadata from image 4a29fc86-7ce4-447e-98ea-c141a6c39b3d to 99c55c33-6c09-418b-b814-11e31429660e. {{(pid=81828) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 25 15:52:39 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Creating volume glance metadata for volume 99c55c33-6c09-418b-b814-11e31429660e backed by image 4a29fc86-7ce4-447e-98ea-c141a6c39b3d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81828) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 25 15:52:39 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759ba67f-af6a-49cb-b326-0349020db2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99c55c33-6c09-418b-b814-11e31429660e', 'volume_size': 1, 'image_id': '4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99560f74c63f4b9285294e59133188d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'created_at': datetime.datetime(2026, 4, 25, 13, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 13, 42, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:39 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (951414ff-587c-4459-bcba-d25ea6bc4531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:39 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Volume volume-99c55c33-6c09-418b-b814-11e31429660e (99c55c33-6c09-418b-b814-11e31429660e): created successfully Apr 25 15:52:39 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (951414ff-587c-4459-bcba-d25ea6bc4531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:39 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Flow 'volume_create_manager' (bec83392-4f38-4de1-8215-d3b0e82b04d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:52:39 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-bd656137-d881-4afd-8727-4456329f31c7 tempest-VolumesGetTest-1958092712 None] Created volume successfully. Apr 25 15:52:39 devstack sudo[87465]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-58de14ad-60e1-483d-9671-cdb4af9382d4 tempest-VolumesSnapshotListTestJSON-1273609158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.1ded605a-c024-4ecd-b224-858881ccdfda" returned: 0 in 0.595s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:39 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-58de14ad-60e1-483d-9671-cdb4af9382d4 tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "cinder-quobyte-1ded605a-c024-4ecd-b224-858881ccdfda" released by "_delete_snapshot" :: held 3.524s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:52:39 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-58de14ad-60e1-483d-9671-cdb4af9382d4 tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "cinder-quobyte-ef032f44-f40e-4e02-860c-d4b3d377fc8b" released by "delete_snapshot" :: held 3.553s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:52:39 devstack sudo[87459]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2a3a17d2-da65-4896-8dc3-d46a8e6e8545" returned: 0 in 0.927s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:39 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] <== create_volume: return (1958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:52:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.963s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:39 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-58de14ad-60e1-483d-9671-cdb4af9382d4 tempest-VolumesSnapshotListTestJSON-1273609158 None] Created reservations ['a6d88a32-e810-4ced-9b38-4b0c97614636', '56cec126-fce2-488c-8c85-8097666d70fb', '5b997eaa-d020-4bb1-af59-b387f6fed067', 'a54a5ca9-513c-47a8-a158-66cec289d020'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:52:39 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee10cde4-de4d-4b94-9d00-87222ff91c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a3a17d2-da65-4896-8dc3-d46a8e6e8545', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:39 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65b0fd2a-cc4d-4203-b8f7-f8f81ab999f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:39 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] Volume volume-2a3a17d2-da65-4896-8dc3-d46a8e6e8545 (2a3a17d2-da65-4896-8dc3-d46a8e6e8545): created successfully Apr 25 15:52:39 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65b0fd2a-cc4d-4203-b8f7-f8f81ab999f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:39 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] Flow 'volume_create_manager' (99b42bc0-22c3-4d81-8265-bfe477aeab6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:52:39 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-58de14ad-60e1-483d-9671-cdb4af9382d4 tempest-VolumesSnapshotListTestJSON-1273609158 None] Delete snapshot completed successfully. Apr 25 15:52:39 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-58de14ad-60e1-483d-9671-cdb4af9382d4 tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "cinder-1ded605a-c024-4ecd-b224-858881ccdfda-delete_snapshot" released by "delete_snapshot" :: held 3.761s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:52:39 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-7754590d-ff66-42d6-a5b9-67c8e5a6cbc3 tempest-VolumesTransfersV357Test-573323191 None] Created volume successfully. Apr 25 15:52:40 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-cb44999c-e1ef-46a0-92f6-e4780da2b76a tempest-VolumesSnapshotListTestJSON-1273609158 None] Acquiring lock "cinder-6572d524-6a29-4df8-89d9-4410fbea2302-delete_snapshot" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:52:40 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-cb44999c-e1ef-46a0-92f6-e4780da2b76a tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "cinder-6572d524-6a29-4df8-89d9-4410fbea2302-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:52:40 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-cb44999c-e1ef-46a0-92f6-e4780da2b76a tempest-VolumesSnapshotListTestJSON-1273609158 None] Acquiring lock "cinder-quobyte-ef032f44-f40e-4e02-860c-d4b3d377fc8b" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:52:40 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-cb44999c-e1ef-46a0-92f6-e4780da2b76a tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "cinder-quobyte-ef032f44-f40e-4e02-860c-d4b3d377fc8b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:52:40 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-cb44999c-e1ef-46a0-92f6-e4780da2b76a tempest-VolumesSnapshotListTestJSON-1273609158 None] Acquiring lock "cinder-quobyte-6572d524-6a29-4df8-89d9-4410fbea2302" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:52:40 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-cb44999c-e1ef-46a0-92f6-e4780da2b76a tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "cinder-quobyte-6572d524-6a29-4df8-89d9-4410fbea2302" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:52:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-cb44999c-e1ef-46a0-92f6-e4780da2b76a tempest-VolumesSnapshotListTestJSON-1273609158 None] Deleting offline snapshot 6572d524-6a29-4df8-89d9-4410fbea2302 of volume ef032f44-f40e-4e02-860c-d4b3d377fc8b {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 15:52:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-cb44999c-e1ef-46a0-92f6-e4780da2b76a tempest-VolumesSnapshotListTestJSON-1273609158 None] snapshot_file for this snap is: volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.6572d524-6a29-4df8-89d9-4410fbea2302 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 15:52:40 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1314fe4-014c-477f-b13a-b6b5063b99fd]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:52:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-cb44999c-e1ef-46a0-92f6-e4780da2b76a tempest-VolumesSnapshotListTestJSON-1273609158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.6572d524-6a29-4df8-89d9-4410fbea2302 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:40 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:52:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] Flow 'volume_create_manager' (0e0c3cd4-49a3-468c-9674-135498f66939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:52:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e69525-d9ca-4e07-a6d1-fa5cd7d0555e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e69525-d9ca-4e07-a6d1-fa5cd7d0555e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:52:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1647203550',display_name='tempest-VolumesGetTest-Volume-72918588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbf4fa4c-f2a8-42ff-9a23-2035690d39c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f26d321e4fad403f96fc2464beedf804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:41Z,use_quota=True,user_id='da38bf8530894933a3fb58a1909c22c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e1ff22-d1db-4c81-929d-47ca7ce0bf48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e1ff22-d1db-4c81-929d-47ca7ce0bf48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ace806-12a5-4ea8-b663-98ef5ba1a2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ace806-12a5-4ea8-b663-98ef5ba1a2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbf4fa4c-f2a8-42ff-9a23-2035690d39c8', 'volume_name': 'volume-cbf4fa4c-f2a8-42ff-9a23-2035690d39c8', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf7ac6bc-48e6-4eb7-800e-dbeed5d0cfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf7ac6bc-48e6-4eb7-800e-dbeed5d0cfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5330c70-dc1b-4e58-832e-168c2b7b869a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:40 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] Volume cbf4fa4c-f2a8-42ff-9a23-2035690d39c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbf4fa4c-f2a8-42ff-9a23-2035690d39c8', 'volume_size': 1} Apr 25 15:52:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:52:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:52:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:52:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1647203550',display_name='tempest-VolumesGetTest-Volume-72918588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbf4fa4c-f2a8-42ff-9a23-2035690d39c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f26d321e4fad403f96fc2464beedf804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:41Z,use_quota=True,user_id='da38bf8530894933a3fb58a1909c22c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:52:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] Creating volume cbf4fa4c-f2a8-42ff-9a23-2035690d39c8 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:52:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:52:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:52:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:52:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:52:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:52:40 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:52:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-cbf4fa4c-f2a8-42ff-9a23-2035690d39c8 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:40 devstack sudo[87471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-cbf4fa4c-f2a8-42ff-9a23-2035690d39c8 1073741824 Apr 25 15:52:40 devstack sudo[87471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:40 devstack sudo[87470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.6572d524-6a29-4df8-89d9-4410fbea2302 Apr 25 15:52:40 devstack sudo[87470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:41 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-99fb33c5-3bce-44fa-8dc2-591566808a1e tempest-VolumesTransfersV357Test-948186883 None] Transfer volume completed successfully. Apr 25 15:52:41 devstack sudo[87470]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-cb44999c-e1ef-46a0-92f6-e4780da2b76a tempest-VolumesSnapshotListTestJSON-1273609158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.6572d524-6a29-4df8-89d9-4410fbea2302" returned: 0 in 0.884s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:41 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-cb44999c-e1ef-46a0-92f6-e4780da2b76a tempest-VolumesSnapshotListTestJSON-1273609158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:52:41 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9303143-97f9-4f75-965a-12883ccea65f]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:52:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-cb44999c-e1ef-46a0-92f6-e4780da2b76a tempest-VolumesSnapshotListTestJSON-1273609158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.60b6814d-2243-4a40-9385-ab9874f61651 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:41 devstack sudo[87471]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-cbf4fa4c-f2a8-42ff-9a23-2035690d39c8 1073741824" returned: 0 in 0.752s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-cbf4fa4c-f2a8-42ff-9a23-2035690d39c8 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:41 devstack sudo[87482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-cbf4fa4c-f2a8-42ff-9a23-2035690d39c8 Apr 25 15:52:41 devstack sudo[87482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:41 devstack sudo[87481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.60b6814d-2243-4a40-9385-ab9874f61651 Apr 25 15:52:41 devstack sudo[87481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:42 devstack sudo[87481]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-cb44999c-e1ef-46a0-92f6-e4780da2b76a tempest-VolumesSnapshotListTestJSON-1273609158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.60b6814d-2243-4a40-9385-ab9874f61651" returned: 0 in 0.752s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:42 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-cb44999c-e1ef-46a0-92f6-e4780da2b76a tempest-VolumesSnapshotListTestJSON-1273609158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:52:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-cb44999c-e1ef-46a0-92f6-e4780da2b76a tempest-VolumesSnapshotListTestJSON-1273609158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.6572d524-6a29-4df8-89d9-4410fbea2302 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:42 devstack sudo[87519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.6572d524-6a29-4df8-89d9-4410fbea2302 Apr 25 15:52:42 devstack sudo[87519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:42 devstack sudo[87482]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-cbf4fa4c-f2a8-42ff-9a23-2035690d39c8" returned: 0 in 0.820s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:42 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:52:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5330c70-dc1b-4e58-832e-168c2b7b869a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbf4fa4c-f2a8-42ff-9a23-2035690d39c8', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263d3c4d-81ff-4a94-9c6d-6e2bb1623202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:42 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] Volume volume-cbf4fa4c-f2a8-42ff-9a23-2035690d39c8 (cbf4fa4c-f2a8-42ff-9a23-2035690d39c8): created successfully Apr 25 15:52:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263d3c4d-81ff-4a94-9c6d-6e2bb1623202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] Flow 'volume_create_manager' (0e0c3cd4-49a3-468c-9674-135498f66939) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:52:42 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-e1df91dd-809d-42df-ae1e-4f7245f3342f tempest-VolumesGetTest-1958092712 None] Created volume successfully. Apr 25 15:52:42 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ed6fcae8-f0b3-48df-aca2-70358ca94978 tempest-VolumesTransfersV357Test-1202687063 None] Acquiring lock "cinder-2a3a17d2-da65-4896-8dc3-d46a8e6e8545-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:52:42 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ed6fcae8-f0b3-48df-aca2-70358ca94978 tempest-VolumesTransfersV357Test-1202687063 None] Lock "cinder-2a3a17d2-da65-4896-8dc3-d46a8e6e8545-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:52:42 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ed6fcae8-f0b3-48df-aca2-70358ca94978 tempest-VolumesTransfersV357Test-1202687063 None] Acquiring lock "cinder-quobyte-2a3a17d2-da65-4896-8dc3-d46a8e6e8545" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:52:42 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ed6fcae8-f0b3-48df-aca2-70358ca94978 tempest-VolumesTransfersV357Test-1202687063 None] Lock "cinder-quobyte-2a3a17d2-da65-4896-8dc3-d46a8e6e8545" acquired by "delete_volume" :: waited 0.018s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:52:42 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[8607adee-552e-4eeb-a6ac-612e9728a75f]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:52:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ed6fcae8-f0b3-48df-aca2-70358ca94978 tempest-VolumesTransfersV357Test-1202687063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2a3a17d2-da65-4896-8dc3-d46a8e6e8545 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:42 devstack sudo[87522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2a3a17d2-da65-4896-8dc3-d46a8e6e8545 Apr 25 15:52:42 devstack sudo[87522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:42 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-88cfe09e-0431-4361-9d22-2b588173c223 tempest-VolumesGetTest-1958092712 None] Acquiring lock "cinder-cbf4fa4c-f2a8-42ff-9a23-2035690d39c8-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:52:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-88cfe09e-0431-4361-9d22-2b588173c223 tempest-VolumesGetTest-1958092712 None] Lock "cinder-cbf4fa4c-f2a8-42ff-9a23-2035690d39c8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:52:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-88cfe09e-0431-4361-9d22-2b588173c223 tempest-VolumesGetTest-1958092712 None] Acquiring lock "cinder-quobyte-cbf4fa4c-f2a8-42ff-9a23-2035690d39c8" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:52:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-88cfe09e-0431-4361-9d22-2b588173c223 tempest-VolumesGetTest-1958092712 None] Lock "cinder-quobyte-cbf4fa4c-f2a8-42ff-9a23-2035690d39c8" acquired by "delete_volume" :: waited 0.019s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:52:43 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bf68e0-a560-48a5-9e57-56d9723ef9a7]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:52:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-88cfe09e-0431-4361-9d22-2b588173c223 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-cbf4fa4c-f2a8-42ff-9a23-2035690d39c8 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:43 devstack sudo[87519]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-cb44999c-e1ef-46a0-92f6-e4780da2b76a tempest-VolumesSnapshotListTestJSON-1273609158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.6572d524-6a29-4df8-89d9-4410fbea2302" returned: 0 in 0.828s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-cb44999c-e1ef-46a0-92f6-e4780da2b76a tempest-VolumesSnapshotListTestJSON-1273609158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.6572d524-6a29-4df8-89d9-4410fbea2302 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:43 devstack sudo[87535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.6572d524-6a29-4df8-89d9-4410fbea2302 Apr 25 15:52:43 devstack sudo[87535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:43 devstack sudo[87532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-cbf4fa4c-f2a8-42ff-9a23-2035690d39c8 Apr 25 15:52:43 devstack sudo[87532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:43 devstack sudo[87522]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ed6fcae8-f0b3-48df-aca2-70358ca94978 tempest-VolumesTransfersV357Test-1202687063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2a3a17d2-da65-4896-8dc3-d46a8e6e8545" returned: 0 in 0.645s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ed6fcae8-f0b3-48df-aca2-70358ca94978 tempest-VolumesTransfersV357Test-1202687063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2a3a17d2-da65-4896-8dc3-d46a8e6e8545 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:43 devstack sudo[87541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2a3a17d2-da65-4896-8dc3-d46a8e6e8545 Apr 25 15:52:43 devstack sudo[87541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:43 devstack sudo[87532]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:43 devstack sudo[87535]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-88cfe09e-0431-4361-9d22-2b588173c223 tempest-VolumesGetTest-1958092712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-cbf4fa4c-f2a8-42ff-9a23-2035690d39c8" returned: 0 in 0.637s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-88cfe09e-0431-4361-9d22-2b588173c223 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-cbf4fa4c-f2a8-42ff-9a23-2035690d39c8 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-cb44999c-e1ef-46a0-92f6-e4780da2b76a tempest-VolumesSnapshotListTestJSON-1273609158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.6572d524-6a29-4df8-89d9-4410fbea2302" returned: 0 in 0.605s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:43 devstack sudo[87557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-cbf4fa4c-f2a8-42ff-9a23-2035690d39c8 Apr 25 15:52:43 devstack sudo[87557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-cb44999c-e1ef-46a0-92f6-e4780da2b76a tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "cinder-quobyte-6572d524-6a29-4df8-89d9-4410fbea2302" released by "_delete_snapshot" :: held 3.243s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:52:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-cb44999c-e1ef-46a0-92f6-e4780da2b76a tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "cinder-quobyte-ef032f44-f40e-4e02-860c-d4b3d377fc8b" released by "delete_snapshot" :: held 3.300s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:52:43 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-cb44999c-e1ef-46a0-92f6-e4780da2b76a tempest-VolumesSnapshotListTestJSON-1273609158 None] Created reservations ['54ea7e90-6b81-49fb-8ff7-1d149283d371', '652b824e-8e64-4e42-9ef4-cf42fca23d73', 'b51c7e69-8513-4c78-9553-6e3be68b432a', 'b09ff5ee-71c1-4769-b074-427cfbf1a031'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:52:43 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-cb44999c-e1ef-46a0-92f6-e4780da2b76a tempest-VolumesSnapshotListTestJSON-1273609158 None] Delete snapshot completed successfully. Apr 25 15:52:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-cb44999c-e1ef-46a0-92f6-e4780da2b76a tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "cinder-6572d524-6a29-4df8-89d9-4410fbea2302-delete_snapshot" released by "delete_snapshot" :: held 3.437s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:52:43 devstack sudo[87541]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ed6fcae8-f0b3-48df-aca2-70358ca94978 tempest-VolumesTransfersV357Test-1202687063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-2a3a17d2-da65-4896-8dc3-d46a8e6e8545" returned: 0 in 0.622s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:44 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ed6fcae8-f0b3-48df-aca2-70358ca94978 tempest-VolumesTransfersV357Test-1202687063 None] Lock "cinder-quobyte-2a3a17d2-da65-4896-8dc3-d46a8e6e8545" released by "delete_volume" :: held 1.309s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:52:44 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-ed6fcae8-f0b3-48df-aca2-70358ca94978 tempest-VolumesTransfersV357Test-1202687063 None] Created reservations ['2aa4fa42-a013-4da5-9cf6-ec16de5a0dbd', '43ae1449-ddb9-4556-bf81-fcc0e092be0c', '487feaea-82fa-45d8-b719-e7e6e043cc8e', '76f05073-f16c-4812-9f8f-33b54822f6fd'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:52:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ed6fcae8-f0b3-48df-aca2-70358ca94978 tempest-VolumesTransfersV357Test-1202687063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:52:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ed6fcae8-f0b3-48df-aca2-70358ca94978 tempest-VolumesTransfersV357Test-1202687063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:52:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-ed6fcae8-f0b3-48df-aca2-70358ca94978 tempest-VolumesTransfersV357Test-1202687063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:52:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-ed6fcae8-f0b3-48df-aca2-70358ca94978 tempest-VolumesTransfersV357Test-1202687063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:52:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ed6fcae8-f0b3-48df-aca2-70358ca94978 tempest-VolumesTransfersV357Test-1202687063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ed6fcae8-f0b3-48df-aca2-70358ca94978 tempest-VolumesTransfersV357Test-1202687063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:44 devstack sudo[87571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:52:44 devstack sudo[87571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:44 devstack sudo[87557]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-88cfe09e-0431-4361-9d22-2b588173c223 tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-cbf4fa4c-f2a8-42ff-9a23-2035690d39c8" returned: 0 in 0.603s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:44 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-88cfe09e-0431-4361-9d22-2b588173c223 tempest-VolumesGetTest-1958092712 None] Lock "cinder-quobyte-cbf4fa4c-f2a8-42ff-9a23-2035690d39c8" released by "delete_volume" :: held 1.278s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:52:44 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-88cfe09e-0431-4361-9d22-2b588173c223 tempest-VolumesGetTest-1958092712 None] Created reservations ['66e06ec5-b3ab-48c9-ac1c-559843f88137', '53b6eff1-23e8-4bf3-9d65-cf1cf6cdfc32', '64192405-4b49-475a-bc58-ad1d7442d6c1', '1f723f7c-7b06-4dd4-9c7f-66747b6bd372'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:52:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-88cfe09e-0431-4361-9d22-2b588173c223 tempest-VolumesGetTest-1958092712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:52:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-88cfe09e-0431-4361-9d22-2b588173c223 tempest-VolumesGetTest-1958092712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:52:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-88cfe09e-0431-4361-9d22-2b588173c223 tempest-VolumesGetTest-1958092712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:52:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-88cfe09e-0431-4361-9d22-2b588173c223 tempest-VolumesGetTest-1958092712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:52:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-88cfe09e-0431-4361-9d22-2b588173c223 tempest-VolumesGetTest-1958092712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-88cfe09e-0431-4361-9d22-2b588173c223 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:44 devstack sudo[87580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:52:44 devstack sudo[87580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:44 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e44efab5-a6f5-463d-a70a-8c0641ac037b tempest-VolumesSnapshotListTestJSON-1273609158 None] Acquiring lock "cinder-60b6814d-2243-4a40-9385-ab9874f61651-delete_snapshot" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:52:44 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e44efab5-a6f5-463d-a70a-8c0641ac037b tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "cinder-60b6814d-2243-4a40-9385-ab9874f61651-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:52:44 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e44efab5-a6f5-463d-a70a-8c0641ac037b tempest-VolumesSnapshotListTestJSON-1273609158 None] Acquiring lock "cinder-quobyte-ef032f44-f40e-4e02-860c-d4b3d377fc8b" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:52:44 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e44efab5-a6f5-463d-a70a-8c0641ac037b tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "cinder-quobyte-ef032f44-f40e-4e02-860c-d4b3d377fc8b" acquired by "delete_snapshot" :: waited 0.031s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:52:44 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e44efab5-a6f5-463d-a70a-8c0641ac037b tempest-VolumesSnapshotListTestJSON-1273609158 None] Acquiring lock "cinder-quobyte-60b6814d-2243-4a40-9385-ab9874f61651" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:52:44 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e44efab5-a6f5-463d-a70a-8c0641ac037b tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "cinder-quobyte-60b6814d-2243-4a40-9385-ab9874f61651" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:52:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-e44efab5-a6f5-463d-a70a-8c0641ac037b tempest-VolumesSnapshotListTestJSON-1273609158 None] Deleting offline snapshot 60b6814d-2243-4a40-9385-ab9874f61651 of volume ef032f44-f40e-4e02-860c-d4b3d377fc8b {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 15:52:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-e44efab5-a6f5-463d-a70a-8c0641ac037b tempest-VolumesSnapshotListTestJSON-1273609158 None] snapshot_file for this snap is: volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.60b6814d-2243-4a40-9385-ab9874f61651 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[e375f092-bc57-4d4c-b193-d0e2334884f5]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e44efab5-a6f5-463d-a70a-8c0641ac037b tempest-VolumesSnapshotListTestJSON-1273609158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.60b6814d-2243-4a40-9385-ab9874f61651 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:45 devstack sudo[87571]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ed6fcae8-f0b3-48df-aca2-70358ca94978 tempest-VolumesTransfersV357Test-1202687063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.881s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-ed6fcae8-f0b3-48df-aca2-70358ca94978 tempest-VolumesTransfersV357Test-1202687063 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:52:45 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-ed6fcae8-f0b3-48df-aca2-70358ca94978 tempest-VolumesTransfersV357Test-1202687063 None] Deleted volume successfully. Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ed6fcae8-f0b3-48df-aca2-70358ca94978 tempest-VolumesTransfersV357Test-1202687063 None] Lock "cinder-2a3a17d2-da65-4896-8dc3-d46a8e6e8545-delete_volume" released by "delete_volume" :: held 2.459s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:52:45 devstack sudo[87594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.60b6814d-2243-4a40-9385-ab9874f61651 Apr 25 15:52:45 devstack sudo[87594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:45 devstack sudo[87580]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-88cfe09e-0431-4361-9d22-2b588173c223 tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 1.008s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-88cfe09e-0431-4361-9d22-2b588173c223 tempest-VolumesGetTest-1958092712 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:52:45 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-88cfe09e-0431-4361-9d22-2b588173c223 tempest-VolumesGetTest-1958092712 None] Deleted volume successfully. Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-88cfe09e-0431-4361-9d22-2b588173c223 tempest-VolumesGetTest-1958092712 None] Lock "cinder-cbf4fa4c-f2a8-42ff-9a23-2035690d39c8-delete_volume" released by "delete_volume" :: held 2.556s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e26b212a-8051-4c74-a51c-a5f43eb01a89 tempest-VolumesGetTest-1958092712 None] Acquiring lock "cinder-99c55c33-6c09-418b-b814-11e31429660e-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e26b212a-8051-4c74-a51c-a5f43eb01a89 tempest-VolumesGetTest-1958092712 None] Lock "cinder-99c55c33-6c09-418b-b814-11e31429660e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] Flow 'volume_create_manager' (3e89c48e-c6a8-45fb-a899-aa21db8b9ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe937b3d-ee4f-4f5e-828c-67b2f39759b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe937b3d-ee4f-4f5e-828c-67b2f39759b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-654603357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e431a1-57d8-42c0-9283-a21851f2e082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15ac06cfc3a847eabe679a89633d723e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:46Z,use_quota=True,user_id='df389e37a57345eb8ef83b6cd237826e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c138af8-d38a-408b-9c90-0b1a4c956e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c138af8-d38a-408b-9c90-0b1a4c956e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8db9a92-71ae-40ec-87d7-a34ad3a88417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8db9a92-71ae-40ec-87d7-a34ad3a88417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6e431a1-57d8-42c0-9283-a21851f2e082', 'volume_name': 'volume-e6e431a1-57d8-42c0-9283-a21851f2e082', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (066a9e5e-951e-4361-adf7-12f18eca731a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (066a9e5e-951e-4361-adf7-12f18eca731a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d7da94-acc3-47dd-8449-a8ab69764da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:45 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] Volume e6e431a1-57d8-42c0-9283-a21851f2e082: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6e431a1-57d8-42c0-9283-a21851f2e082', 'volume_size': 1} Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-654603357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6e431a1-57d8-42c0-9283-a21851f2e082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15ac06cfc3a847eabe679a89633d723e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:52:46Z,use_quota=True,user_id='df389e37a57345eb8ef83b6cd237826e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] Creating volume e6e431a1-57d8-42c0-9283-a21851f2e082 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:52:45 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e6e431a1-57d8-42c0-9283-a21851f2e082 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:45 devstack sudo[87598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e6e431a1-57d8-42c0-9283-a21851f2e082 1073741824 Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e26b212a-8051-4c74-a51c-a5f43eb01a89 tempest-VolumesGetTest-1958092712 None] Acquiring lock "cinder-quobyte-99c55c33-6c09-418b-b814-11e31429660e" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:52:45 devstack sudo[87598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e26b212a-8051-4c74-a51c-a5f43eb01a89 tempest-VolumesGetTest-1958092712 None] Lock "cinder-quobyte-99c55c33-6c09-418b-b814-11e31429660e" acquired by "delete_volume" :: waited 0.017s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8944b3d-7d55-4766-bef2-3419f042e568]: (4, 'raw') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:52:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e26b212a-8051-4c74-a51c-a5f43eb01a89 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99c55c33-6c09-418b-b814-11e31429660e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:46 devstack sudo[87603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99c55c33-6c09-418b-b814-11e31429660e Apr 25 15:52:46 devstack sudo[87603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:46 devstack sudo[87594]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e44efab5-a6f5-463d-a70a-8c0641ac037b tempest-VolumesSnapshotListTestJSON-1273609158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.60b6814d-2243-4a40-9385-ab9874f61651" returned: 0 in 1.006s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:46 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-e44efab5-a6f5-463d-a70a-8c0641ac037b tempest-VolumesSnapshotListTestJSON-1273609158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:52:46 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86882ed-dd92-4ac6-b25d-114d8c7d1e55]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:52:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e44efab5-a6f5-463d-a70a-8c0641ac037b tempest-VolumesSnapshotListTestJSON-1273609158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:46 devstack sudo[87606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b Apr 25 15:52:46 devstack sudo[87606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:46 devstack sudo[87603]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e26b212a-8051-4c74-a51c-a5f43eb01a89 tempest-VolumesGetTest-1958092712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99c55c33-6c09-418b-b814-11e31429660e" returned: 0 in 0.810s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e26b212a-8051-4c74-a51c-a5f43eb01a89 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99c55c33-6c09-418b-b814-11e31429660e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:46 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-8e55460e-449a-43d8-99f2-cc8ff9815b25 tempest-ServerRescueNegativeTestJSON-1935342506 None] Acquiring lock "cinder-0a45e8f5-ff6e-4ecd-9101-63e5ee7e1b13-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:52:46 devstack sudo[87598]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:46 devstack sudo[87614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99c55c33-6c09-418b-b814-11e31429660e Apr 25 15:52:46 devstack sudo[87614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e6e431a1-57d8-42c0-9283-a21851f2e082 1073741824" returned: 0 in 1.150s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:46 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-8e55460e-449a-43d8-99f2-cc8ff9815b25 tempest-ServerRescueNegativeTestJSON-1935342506 None] Lock "cinder-0a45e8f5-ff6e-4ecd-9101-63e5ee7e1b13-delete_volume" acquired by "delete_volume" :: waited 0.153s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:52:47 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-8e55460e-449a-43d8-99f2-cc8ff9815b25 tempest-ServerRescueNegativeTestJSON-1935342506 None] Acquiring lock "cinder-quobyte-0a45e8f5-ff6e-4ecd-9101-63e5ee7e1b13" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:52:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e6e431a1-57d8-42c0-9283-a21851f2e082 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:47 devstack sudo[87606]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:47 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-8e55460e-449a-43d8-99f2-cc8ff9815b25 tempest-ServerRescueNegativeTestJSON-1935342506 None] Lock "cinder-quobyte-0a45e8f5-ff6e-4ecd-9101-63e5ee7e1b13" acquired by "delete_volume" :: waited 0.044s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:52:47 devstack sudo[87618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e6e431a1-57d8-42c0-9283-a21851f2e082 Apr 25 15:52:47 devstack sudo[87618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e44efab5-a6f5-463d-a70a-8c0641ac037b tempest-VolumesSnapshotListTestJSON-1273609158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b" returned: 0 in 1.009s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e44efab5-a6f5-463d-a70a-8c0641ac037b tempest-VolumesSnapshotListTestJSON-1273609158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.60b6814d-2243-4a40-9385-ab9874f61651 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:47 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[684ca8ad-0535-490e-891b-4a269017b1c6]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:52:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8e55460e-449a-43d8-99f2-cc8ff9815b25 tempest-ServerRescueNegativeTestJSON-1935342506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0a45e8f5-ff6e-4ecd-9101-63e5ee7e1b13 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:47 devstack sudo[87620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.60b6814d-2243-4a40-9385-ab9874f61651 Apr 25 15:52:47 devstack sudo[87620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:47 devstack sudo[87621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0a45e8f5-ff6e-4ecd-9101-63e5ee7e1b13 Apr 25 15:52:47 devstack sudo[87621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:47 devstack sudo[87614]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e26b212a-8051-4c74-a51c-a5f43eb01a89 tempest-VolumesGetTest-1958092712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99c55c33-6c09-418b-b814-11e31429660e" returned: 1 in 1.030s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e26b212a-8051-4c74-a51c-a5f43eb01a89 tempest-VolumesGetTest-1958092712 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99c55c33-6c09-418b-b814-11e31429660e' failed. Not Retrying. {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 25 15:52:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e26b212a-8051-4c74-a51c-a5f43eb01a89 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99c55c33-6c09-418b-b814-11e31429660e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:47 devstack sudo[87633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99c55c33-6c09-418b-b814-11e31429660e Apr 25 15:52:47 devstack sudo[87633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:47 devstack sudo[87620]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e44efab5-a6f5-463d-a70a-8c0641ac037b tempest-VolumesSnapshotListTestJSON-1273609158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.60b6814d-2243-4a40-9385-ab9874f61651" returned: 0 in 0.794s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e44efab5-a6f5-463d-a70a-8c0641ac037b tempest-VolumesSnapshotListTestJSON-1273609158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.60b6814d-2243-4a40-9385-ab9874f61651 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:47 devstack sudo[87636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.60b6814d-2243-4a40-9385-ab9874f61651 Apr 25 15:52:47 devstack sudo[87636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:47 devstack sudo[87618]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e6e431a1-57d8-42c0-9283-a21851f2e082" returned: 0 in 0.927s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] <== create_volume: return (2168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:52:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.170s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d7da94-acc3-47dd-8449-a8ab69764da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6e431a1-57d8-42c0-9283-a21851f2e082', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (935172b5-b553-4fb4-b73a-5d21b2c4c81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:52:48 devstack sudo[87621]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8e55460e-449a-43d8-99f2-cc8ff9815b25 tempest-ServerRescueNegativeTestJSON-1935342506 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0a45e8f5-ff6e-4ecd-9101-63e5ee7e1b13" returned: 0 in 0.931s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8e55460e-449a-43d8-99f2-cc8ff9815b25 tempest-ServerRescueNegativeTestJSON-1935342506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0a45e8f5-ff6e-4ecd-9101-63e5ee7e1b13 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:48 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] Volume volume-e6e431a1-57d8-42c0-9283-a21851f2e082 (e6e431a1-57d8-42c0-9283-a21851f2e082): created successfully Apr 25 15:52:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (935172b5-b553-4fb4-b73a-5d21b2c4c81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:52:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] Flow 'volume_create_manager' (3e89c48e-c6a8-45fb-a899-aa21db8b9ca1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:52:48 devstack sudo[87638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0a45e8f5-ff6e-4ecd-9101-63e5ee7e1b13 Apr 25 15:52:48 devstack sudo[87638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:48 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-bfaaa9f6-4939-4e40-b00c-005e771c8b35 tempest-VolumesTransfersV357Test-573323191 None] Created volume successfully. Apr 25 15:52:48 devstack sudo[87633]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e26b212a-8051-4c74-a51c-a5f43eb01a89 tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99c55c33-6c09-418b-b814-11e31429660e" returned: 0 in 0.558s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:48 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e26b212a-8051-4c74-a51c-a5f43eb01a89 tempest-VolumesGetTest-1958092712 None] Lock "cinder-quobyte-99c55c33-6c09-418b-b814-11e31429660e" released by "delete_volume" :: held 2.510s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:52:48 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-e26b212a-8051-4c74-a51c-a5f43eb01a89 tempest-VolumesGetTest-1958092712 None] Created reservations ['85dc96f4-bca8-4936-9eed-b0fd23072fb1', 'f02e4bd3-f36f-4437-a391-a862903961aa', '401fade7-9815-4c6a-9117-ec8956ee0acd', 'd4979852-824d-49f9-a1aa-49d8cb60e9ba'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:52:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e26b212a-8051-4c74-a51c-a5f43eb01a89 tempest-VolumesGetTest-1958092712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:52:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e26b212a-8051-4c74-a51c-a5f43eb01a89 tempest-VolumesGetTest-1958092712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:52:48 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e26b212a-8051-4c74-a51c-a5f43eb01a89 tempest-VolumesGetTest-1958092712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:52:48 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e26b212a-8051-4c74-a51c-a5f43eb01a89 tempest-VolumesGetTest-1958092712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:52:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e26b212a-8051-4c74-a51c-a5f43eb01a89 tempest-VolumesGetTest-1958092712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e26b212a-8051-4c74-a51c-a5f43eb01a89 tempest-VolumesGetTest-1958092712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:48 devstack sudo[87636]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e44efab5-a6f5-463d-a70a-8c0641ac037b tempest-VolumesSnapshotListTestJSON-1273609158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b.60b6814d-2243-4a40-9385-ab9874f61651" returned: 0 in 0.620s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:48 devstack sudo[87643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:52:48 devstack sudo[87643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:48 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e44efab5-a6f5-463d-a70a-8c0641ac037b tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "cinder-quobyte-60b6814d-2243-4a40-9385-ab9874f61651" released by "_delete_snapshot" :: held 3.596s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:52:48 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e44efab5-a6f5-463d-a70a-8c0641ac037b tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "cinder-quobyte-ef032f44-f40e-4e02-860c-d4b3d377fc8b" released by "delete_snapshot" :: held 3.650s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:52:48 devstack sudo[87638]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8e55460e-449a-43d8-99f2-cc8ff9815b25 tempest-ServerRescueNegativeTestJSON-1935342506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0a45e8f5-ff6e-4ecd-9101-63e5ee7e1b13" returned: 0 in 0.563s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:48 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-e44efab5-a6f5-463d-a70a-8c0641ac037b tempest-VolumesSnapshotListTestJSON-1273609158 None] Created reservations ['f8cf7401-5261-42be-b75a-0053823b5a83', '218837eb-e041-47f9-a7ea-3343e214ea5f', 'eaae49b9-d292-427e-ad15-1d8d3ba96aee', 'aafddef0-b1b6-404b-80e5-12839750d941'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:52:48 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-8e55460e-449a-43d8-99f2-cc8ff9815b25 tempest-ServerRescueNegativeTestJSON-1935342506 None] Lock "cinder-quobyte-0a45e8f5-ff6e-4ecd-9101-63e5ee7e1b13" released by "delete_volume" :: held 1.554s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:52:48 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-e44efab5-a6f5-463d-a70a-8c0641ac037b tempest-VolumesSnapshotListTestJSON-1273609158 None] Delete snapshot completed successfully. Apr 25 15:52:48 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e44efab5-a6f5-463d-a70a-8c0641ac037b tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "cinder-60b6814d-2243-4a40-9385-ab9874f61651-delete_snapshot" released by "delete_snapshot" :: held 3.843s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:52:48 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-8e55460e-449a-43d8-99f2-cc8ff9815b25 tempest-ServerRescueNegativeTestJSON-1935342506 None] Created reservations ['662ac280-7449-4453-a798-3493de2b49de', 'e0a4c2f7-6915-458f-b282-6cdec3440f78', '9d6292bc-7666-4c44-aa1f-2f06a2d30604', 'f902850d-3a59-49b6-9d3c-e391c540c8ce'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:52:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-8e55460e-449a-43d8-99f2-cc8ff9815b25 tempest-ServerRescueNegativeTestJSON-1935342506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:52:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-8e55460e-449a-43d8-99f2-cc8ff9815b25 tempest-ServerRescueNegativeTestJSON-1935342506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:52:48 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-8e55460e-449a-43d8-99f2-cc8ff9815b25 tempest-ServerRescueNegativeTestJSON-1935342506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:52:48 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-8e55460e-449a-43d8-99f2-cc8ff9815b25 tempest-ServerRescueNegativeTestJSON-1935342506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:52:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-8e55460e-449a-43d8-99f2-cc8ff9815b25 tempest-ServerRescueNegativeTestJSON-1935342506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8e55460e-449a-43d8-99f2-cc8ff9815b25 tempest-ServerRescueNegativeTestJSON-1935342506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:48 devstack sudo[87645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:52:48 devstack sudo[87645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:49 devstack sudo[87643]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e26b212a-8051-4c74-a51c-a5f43eb01a89 tempest-VolumesGetTest-1958092712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.581s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:49 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-e26b212a-8051-4c74-a51c-a5f43eb01a89 tempest-VolumesGetTest-1958092712 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:52:49 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-e26b212a-8051-4c74-a51c-a5f43eb01a89 tempest-VolumesGetTest-1958092712 None] Deleted volume successfully. Apr 25 15:52:49 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e26b212a-8051-4c74-a51c-a5f43eb01a89 tempest-VolumesGetTest-1958092712 None] Lock "cinder-99c55c33-6c09-418b-b814-11e31429660e-delete_volume" released by "delete_volume" :: held 3.386s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:52:49 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fb1a528f-713a-45a5-950e-b63325c865e1 tempest-VolumesSnapshotListTestJSON-1273609158 None] Acquiring lock "cinder-ef032f44-f40e-4e02-860c-d4b3d377fc8b-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:52:49 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fb1a528f-713a-45a5-950e-b63325c865e1 tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "cinder-ef032f44-f40e-4e02-860c-d4b3d377fc8b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:52:49 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fb1a528f-713a-45a5-950e-b63325c865e1 tempest-VolumesSnapshotListTestJSON-1273609158 None] Acquiring lock "cinder-quobyte-ef032f44-f40e-4e02-860c-d4b3d377fc8b" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:52:49 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fb1a528f-713a-45a5-950e-b63325c865e1 tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "cinder-quobyte-ef032f44-f40e-4e02-860c-d4b3d377fc8b" acquired by "delete_volume" :: waited 0.019s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:52:49 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f03bbee2-ce23-4dea-abc3-74bf2d3a2b5b tempest-VolumesTransfersV357Test-1202687063 None] Acquiring lock "cinder-e6e431a1-57d8-42c0-9283-a21851f2e082-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:52:49 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e6c075-25b2-4344-9a58-9bec3d40ae6d]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:52:49 devstack sudo[87645]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fb1a528f-713a-45a5-950e-b63325c865e1 tempest-VolumesSnapshotListTestJSON-1273609158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:49 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f03bbee2-ce23-4dea-abc3-74bf2d3a2b5b tempest-VolumesTransfersV357Test-1202687063 None] Lock "cinder-e6e431a1-57d8-42c0-9283-a21851f2e082-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:52:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8e55460e-449a-43d8-99f2-cc8ff9815b25 tempest-ServerRescueNegativeTestJSON-1935342506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.849s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:49 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-8e55460e-449a-43d8-99f2-cc8ff9815b25 tempest-ServerRescueNegativeTestJSON-1935342506 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:52:49 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-8e55460e-449a-43d8-99f2-cc8ff9815b25 tempest-ServerRescueNegativeTestJSON-1935342506 None] Deleted volume successfully. Apr 25 15:52:49 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f03bbee2-ce23-4dea-abc3-74bf2d3a2b5b tempest-VolumesTransfersV357Test-1202687063 None] Acquiring lock "cinder-quobyte-e6e431a1-57d8-42c0-9283-a21851f2e082" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:52:49 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f03bbee2-ce23-4dea-abc3-74bf2d3a2b5b tempest-VolumesTransfersV357Test-1202687063 None] Lock "cinder-quobyte-e6e431a1-57d8-42c0-9283-a21851f2e082" acquired by "delete_volume" :: waited 0.022s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:52:49 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-8e55460e-449a-43d8-99f2-cc8ff9815b25 tempest-ServerRescueNegativeTestJSON-1935342506 None] Lock "cinder-0a45e8f5-ff6e-4ecd-9101-63e5ee7e1b13-delete_volume" released by "delete_volume" :: held 2.782s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:52:49 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[67778bc3-a842-4af3-b015-cc2dd10d6312]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:52:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f03bbee2-ce23-4dea-abc3-74bf2d3a2b5b tempest-VolumesTransfersV357Test-1202687063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e6e431a1-57d8-42c0-9283-a21851f2e082 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:49 devstack sudo[87650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b Apr 25 15:52:49 devstack sudo[87650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:49 devstack sudo[87651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e6e431a1-57d8-42c0-9283-a21851f2e082 Apr 25 15:52:49 devstack sudo[87651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:50 devstack sudo[87651]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f03bbee2-ce23-4dea-abc3-74bf2d3a2b5b tempest-VolumesTransfersV357Test-1202687063 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e6e431a1-57d8-42c0-9283-a21851f2e082" returned: 0 in 0.811s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f03bbee2-ce23-4dea-abc3-74bf2d3a2b5b tempest-VolumesTransfersV357Test-1202687063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e6e431a1-57d8-42c0-9283-a21851f2e082 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:50 devstack sudo[87650]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fb1a528f-713a-45a5-950e-b63325c865e1 tempest-VolumesSnapshotListTestJSON-1273609158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b" returned: 0 in 1.051s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fb1a528f-713a-45a5-950e-b63325c865e1 tempest-VolumesSnapshotListTestJSON-1273609158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:50 devstack sudo[87666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e6e431a1-57d8-42c0-9283-a21851f2e082 Apr 25 15:52:50 devstack sudo[87666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:50 devstack sudo[87667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b Apr 25 15:52:50 devstack sudo[87667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:51 devstack sudo[87667]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fb1a528f-713a-45a5-950e-b63325c865e1 tempest-VolumesSnapshotListTestJSON-1273609158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ef032f44-f40e-4e02-860c-d4b3d377fc8b" returned: 0 in 1.077s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:51 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fb1a528f-713a-45a5-950e-b63325c865e1 tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "cinder-quobyte-ef032f44-f40e-4e02-860c-d4b3d377fc8b" released by "delete_volume" :: held 2.248s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:52:51 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-fb1a528f-713a-45a5-950e-b63325c865e1 tempest-VolumesSnapshotListTestJSON-1273609158 None] Created reservations ['ebbb6927-d78d-4f48-ae0f-29ee6eb6898b', '20c3b3b6-e8b5-4777-90bb-87e9e87617e2', '70827127-26e1-4e3e-9e23-ab55e9611d1d', '99f1182f-55aa-4705-8c41-b8f7efbf0139'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:52:51 devstack sudo[87666]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f03bbee2-ce23-4dea-abc3-74bf2d3a2b5b tempest-VolumesTransfersV357Test-1202687063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e6e431a1-57d8-42c0-9283-a21851f2e082" returned: 0 in 1.229s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:51 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f03bbee2-ce23-4dea-abc3-74bf2d3a2b5b tempest-VolumesTransfersV357Test-1202687063 None] Lock "cinder-quobyte-e6e431a1-57d8-42c0-9283-a21851f2e082" released by "delete_volume" :: held 2.189s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:52:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fb1a528f-713a-45a5-950e-b63325c865e1 tempest-VolumesSnapshotListTestJSON-1273609158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:52:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fb1a528f-713a-45a5-950e-b63325c865e1 tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:52:51 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-fb1a528f-713a-45a5-950e-b63325c865e1 tempest-VolumesSnapshotListTestJSON-1273609158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:52:51 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-fb1a528f-713a-45a5-950e-b63325c865e1 tempest-VolumesSnapshotListTestJSON-1273609158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:52:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fb1a528f-713a-45a5-950e-b63325c865e1 tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fb1a528f-713a-45a5-950e-b63325c865e1 tempest-VolumesSnapshotListTestJSON-1273609158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:52 devstack sudo[87701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:52:52 devstack sudo[87701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:52 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-f03bbee2-ce23-4dea-abc3-74bf2d3a2b5b tempest-VolumesTransfersV357Test-1202687063 None] Created reservations ['d004521b-fe1e-44cc-8f53-4d28ae7321d4', '1dee1bc1-1ab4-4fa2-8fa0-328765681f63', '2b185400-ec84-4346-b4e5-2dec80a81233', 'ff61ea92-1ef3-44b0-bab7-bee7ee72fa84'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:52:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f03bbee2-ce23-4dea-abc3-74bf2d3a2b5b tempest-VolumesTransfersV357Test-1202687063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:52:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f03bbee2-ce23-4dea-abc3-74bf2d3a2b5b tempest-VolumesTransfersV357Test-1202687063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:52:52 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f03bbee2-ce23-4dea-abc3-74bf2d3a2b5b tempest-VolumesTransfersV357Test-1202687063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:52:52 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f03bbee2-ce23-4dea-abc3-74bf2d3a2b5b tempest-VolumesTransfersV357Test-1202687063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:52:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f03bbee2-ce23-4dea-abc3-74bf2d3a2b5b tempest-VolumesTransfersV357Test-1202687063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:52:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f03bbee2-ce23-4dea-abc3-74bf2d3a2b5b tempest-VolumesTransfersV357Test-1202687063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:52:52 devstack sudo[87703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:52:52 devstack sudo[87703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:52:52 devstack sudo[87703]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f03bbee2-ce23-4dea-abc3-74bf2d3a2b5b tempest-VolumesTransfersV357Test-1202687063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.673s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:52 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-f03bbee2-ce23-4dea-abc3-74bf2d3a2b5b tempest-VolumesTransfersV357Test-1202687063 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:52:52 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-f03bbee2-ce23-4dea-abc3-74bf2d3a2b5b tempest-VolumesTransfersV357Test-1202687063 None] Deleted volume successfully. Apr 25 15:52:52 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f03bbee2-ce23-4dea-abc3-74bf2d3a2b5b tempest-VolumesTransfersV357Test-1202687063 None] Lock "cinder-e6e431a1-57d8-42c0-9283-a21851f2e082-delete_volume" released by "delete_volume" :: held 3.236s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:52:52 devstack sudo[87701]: pam_unix(sudo:session): session closed for user root Apr 25 15:52:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fb1a528f-713a-45a5-950e-b63325c865e1 tempest-VolumesSnapshotListTestJSON-1273609158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.935s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:52:52 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-fb1a528f-713a-45a5-950e-b63325c865e1 tempest-VolumesSnapshotListTestJSON-1273609158 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:52:52 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-fb1a528f-713a-45a5-950e-b63325c865e1 tempest-VolumesSnapshotListTestJSON-1273609158 None] Deleted volume successfully. Apr 25 15:52:52 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fb1a528f-713a-45a5-950e-b63325c865e1 tempest-VolumesSnapshotListTestJSON-1273609158 None] Lock "cinder-ef032f44-f40e-4e02-860c-d4b3d377fc8b-delete_volume" released by "delete_volume" :: held 3.612s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:53:00 devstack cinder-volume[81828]: DEBUG oslo_service.periodic_task [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81828) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 25 15:53:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:53:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:53:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:00 devstack sudo[87743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:53:00 devstack sudo[87743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:00 devstack sudo[87743]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.643s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:00 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:53:02 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:UPDATE=127,cinder:SELECT=91,cinder:INSERT=38,cinder:DELETE=10 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:53:02 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:UPDATE=142,cinder:SELECT=107,cinder:INSERT=40,cinder:DELETE=13 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:53:03 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:53:03 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] Flow 'volume_create_manager' (ba140d3e-1408-4f6e-a312-ecff9659459c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:53:03 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b6a553e-526a-4fd1-b134-899d5a6fab31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:03 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b6a553e-526a-4fd1-b134-899d5a6fab31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-270444323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56f855a9-7b16-4576-9a18-0d90e5c0c49e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fac2be0c4c884e5eb0d81c2901730c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:53:03Z,use_quota=True,user_id='b9e886838f024befa09b8939ce41f304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:03 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5c619c-7c6f-4f99-a1db-ff9841761c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:03 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5c619c-7c6f-4f99-a1db-ff9841761c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:03 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d949887-c879-404a-bb58-ae79d5d36ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:03 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d949887-c879-404a-bb58-ae79d5d36ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56f855a9-7b16-4576-9a18-0d90e5c0c49e', 'volume_name': 'volume-56f855a9-7b16-4576-9a18-0d90e5c0c49e', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:03 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0560bc6-dd32-4d49-914a-bf16edd26b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:03 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0560bc6-dd32-4d49-914a-bf16edd26b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:03 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99afadeb-367d-4c47-b025-fabc9c51ddfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:03 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] Volume 56f855a9-7b16-4576-9a18-0d90e5c0c49e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56f855a9-7b16-4576-9a18-0d90e5c0c49e', 'volume_size': 1} Apr 25 15:53:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:03 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:53:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-270444323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56f855a9-7b16-4576-9a18-0d90e5c0c49e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fac2be0c4c884e5eb0d81c2901730c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:53:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:53:03Z,use_quota=True,user_id='b9e886838f024befa09b8939ce41f304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:53:03 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] Creating volume 56f855a9-7b16-4576-9a18-0d90e5c0c49e {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:53:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:03 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:53:03 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:53:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:03 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:53:03 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:53:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-56f855a9-7b16-4576-9a18-0d90e5c0c49e 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:03 devstack sudo[87748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-56f855a9-7b16-4576-9a18-0d90e5c0c49e 1073741824 Apr 25 15:53:03 devstack sudo[87748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:04 devstack sudo[87748]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-56f855a9-7b16-4576-9a18-0d90e5c0c49e 1073741824" returned: 0 in 0.673s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-56f855a9-7b16-4576-9a18-0d90e5c0c49e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:04 devstack sudo[87753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-56f855a9-7b16-4576-9a18-0d90e5c0c49e Apr 25 15:53:04 devstack sudo[87753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:04 devstack sudo[87753]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-56f855a9-7b16-4576-9a18-0d90e5c0c49e" returned: 0 in 0.600s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:04 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:53:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:04 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99afadeb-367d-4c47-b025-fabc9c51ddfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56f855a9-7b16-4576-9a18-0d90e5c0c49e', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:04 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da81d3cd-c7fb-44a1-ad32-b5cdd010519d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:04 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] Volume volume-56f855a9-7b16-4576-9a18-0d90e5c0c49e (56f855a9-7b16-4576-9a18-0d90e5c0c49e): created successfully Apr 25 15:53:04 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da81d3cd-c7fb-44a1-ad32-b5cdd010519d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:04 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] Flow 'volume_create_manager' (ba140d3e-1408-4f6e-a312-ecff9659459c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:53:04 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-b3c25dce-ac3a-4f34-a344-62e9fd6b4294 tempest-VolumesListTestJSON-66795487 None] Created volume successfully. Apr 25 15:53:05 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:53:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] Flow 'volume_create_manager' (b40a2907-bec9-4d40-b975-4b847a8db714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:53:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b27b7dc-4428-4a04-bb8d-641e3ad7be3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b27b7dc-4428-4a04-bb8d-641e3ad7be3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-926517793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d42f1d5-657c-4484-bc65-365ff0883b5e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fac2be0c4c884e5eb0d81c2901730c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:53:06Z,use_quota=True,user_id='b9e886838f024befa09b8939ce41f304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d8fea7-84bc-4e18-89f3-a55e6b1575e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63d8fea7-84bc-4e18-89f3-a55e6b1575e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4716aa53-33fe-4421-ae1b-5c4697107365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4716aa53-33fe-4421-ae1b-5c4697107365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d42f1d5-657c-4484-bc65-365ff0883b5e', 'volume_name': 'volume-1d42f1d5-657c-4484-bc65-365ff0883b5e', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd6eac1-8074-4eb2-b5b5-4272e5acc1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fd6eac1-8074-4eb2-b5b5-4272e5acc1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6418a76c-aaa5-49a5-8466-f6bf6252c61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:05 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] Volume 1d42f1d5-657c-4484-bc65-365ff0883b5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d42f1d5-657c-4484-bc65-365ff0883b5e', 'volume_size': 1} Apr 25 15:53:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:05 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-926517793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d42f1d5-657c-4484-bc65-365ff0883b5e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fac2be0c4c884e5eb0d81c2901730c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:53:06Z,use_quota=True,user_id='b9e886838f024befa09b8939ce41f304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:53:05 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] Creating volume 1d42f1d5-657c-4484-bc65-365ff0883b5e {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:53:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:05 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:53:06 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:53:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:06 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:53:06 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:53:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1d42f1d5-657c-4484-bc65-365ff0883b5e 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:06 devstack sudo[87757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1d42f1d5-657c-4484-bc65-365ff0883b5e 1073741824 Apr 25 15:53:06 devstack sudo[87757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:06 devstack sudo[87757]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1d42f1d5-657c-4484-bc65-365ff0883b5e 1073741824" returned: 0 in 0.772s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1d42f1d5-657c-4484-bc65-365ff0883b5e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:06 devstack sudo[87762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1d42f1d5-657c-4484-bc65-365ff0883b5e Apr 25 15:53:06 devstack sudo[87762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:07 devstack sudo[87762]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1d42f1d5-657c-4484-bc65-365ff0883b5e" returned: 0 in 0.568s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:07 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] <== create_volume: return (1386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:53:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.388s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:07 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6418a76c-aaa5-49a5-8466-f6bf6252c61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d42f1d5-657c-4484-bc65-365ff0883b5e', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:07 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (869a8e77-0f1b-41a5-b169-d7af91d0490e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:07 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] Volume volume-1d42f1d5-657c-4484-bc65-365ff0883b5e (1d42f1d5-657c-4484-bc65-365ff0883b5e): created successfully Apr 25 15:53:07 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (869a8e77-0f1b-41a5-b169-d7af91d0490e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:07 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] Flow 'volume_create_manager' (b40a2907-bec9-4d40-b975-4b847a8db714) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:53:07 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-507bff7b-a0d3-43c7-9eea-a879e58f85e2 tempest-VolumesListTestJSON-66795487 None] Created volume successfully. Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] Flow 'volume_create_manager' (5e85f760-3ced-4eb7-ab1e-f6e3b3cbe849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69811329-18ca-4499-9684-72a8544dbb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69811329-18ca-4499-9684-72a8544dbb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-835081075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52560221-3fdb-48b2-b76f-72f286d5188d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4db9c91c22c146dc83a399cfea0a4c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:53:08Z,use_quota=True,user_id='90f6adadb99a4c8485b48ebbc5672c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c85c680d-f830-4045-8fc4-80ecac853d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c85c680d-f830-4045-8fc4-80ecac853d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f775a8b-c4fa-4d81-a73a-095d3edaecca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f775a8b-c4fa-4d81-a73a-095d3edaecca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52560221-3fdb-48b2-b76f-72f286d5188d', 'volume_name': 'volume-52560221-3fdb-48b2-b76f-72f286d5188d', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119dcd44-d238-4874-8369-8b9a701a6b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (119dcd44-d238-4874-8369-8b9a701a6b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95550f8f-e06e-42c0-be65-fe012a0608f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:08 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] Volume 52560221-3fdb-48b2-b76f-72f286d5188d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52560221-3fdb-48b2-b76f-72f286d5188d', 'volume_size': 1} Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-835081075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52560221-3fdb-48b2-b76f-72f286d5188d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4db9c91c22c146dc83a399cfea0a4c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:53:08Z,use_quota=True,user_id='90f6adadb99a4c8485b48ebbc5672c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] Creating volume 52560221-3fdb-48b2-b76f-72f286d5188d {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:53:08 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:08 devstack sudo[87766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d 1073741824 Apr 25 15:53:08 devstack sudo[87766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] Flow 'volume_create_manager' (7e702bd8-d4a8-4b0e-acc2-6e3e92daac04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faed167f-eefc-4ab3-812f-5637bf87e2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faed167f-eefc-4ab3-812f-5637bf87e2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-770117702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2440662-1ddd-4414-8c96-c52d1bdd0b84,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fac2be0c4c884e5eb0d81c2901730c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:53:08Z,use_quota=True,user_id='b9e886838f024befa09b8939ce41f304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaa28f19-53a7-43e9-ac91-e6fabb394580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaa28f19-53a7-43e9-ac91-e6fabb394580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3cf5144-0031-4de6-a6a5-9cb858fc3853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3cf5144-0031-4de6-a6a5-9cb858fc3853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2440662-1ddd-4414-8c96-c52d1bdd0b84', 'volume_name': 'volume-f2440662-1ddd-4414-8c96-c52d1bdd0b84', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dbcbfa1-10b5-4fcb-bff4-53ca42926bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dbcbfa1-10b5-4fcb-bff4-53ca42926bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eb851f8-affd-4117-96c8-6088a32cea5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:08 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] Volume f2440662-1ddd-4414-8c96-c52d1bdd0b84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2440662-1ddd-4414-8c96-c52d1bdd0b84', 'volume_size': 1} Apr 25 15:53:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:09 devstack sudo[87766]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d 1073741824" returned: 0 in 0.691s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:09 devstack sudo[87771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d Apr 25 15:53:09 devstack sudo[87771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:09 devstack sudo[87771]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d" returned: 0 in 0.474s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:09 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:53:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.058s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:09 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-770117702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2440662-1ddd-4414-8c96-c52d1bdd0b84,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fac2be0c4c884e5eb0d81c2901730c67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:53:08Z,use_quota=True,user_id='b9e886838f024befa09b8939ce41f304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:53:09 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] Creating volume f2440662-1ddd-4414-8c96-c52d1bdd0b84 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:53:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:09 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:53:09 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:53:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:09 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:53:09 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:53:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f2440662-1ddd-4414-8c96-c52d1bdd0b84 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:09 devstack sudo[87774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f2440662-1ddd-4414-8c96-c52d1bdd0b84 1073741824 Apr 25 15:53:09 devstack sudo[87774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:09 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95550f8f-e06e-42c0-be65-fe012a0608f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52560221-3fdb-48b2-b76f-72f286d5188d', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:09 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88483d8d-0c9b-462e-8b98-38dc47031a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:09 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] Volume volume-52560221-3fdb-48b2-b76f-72f286d5188d (52560221-3fdb-48b2-b76f-72f286d5188d): created successfully Apr 25 15:53:09 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88483d8d-0c9b-462e-8b98-38dc47031a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:09 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] Flow 'volume_create_manager' (5e85f760-3ced-4eb7-ab1e-f6e3b3cbe849) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:53:09 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-b7b2c542-0043-48e8-8df2-73d605f76cc2 tempest-VolumesSnapshotTestJSON-1680973878 None] Created volume successfully. Apr 25 15:53:10 devstack sudo[87774]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f2440662-1ddd-4414-8c96-c52d1bdd0b84 1073741824" returned: 0 in 0.645s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f2440662-1ddd-4414-8c96-c52d1bdd0b84 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:10 devstack sudo[87779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f2440662-1ddd-4414-8c96-c52d1bdd0b84 Apr 25 15:53:10 devstack sudo[87779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-669e12ed-9a08-4191-bb1c-f05d554f1071 tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:10 devstack sudo[87779]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f2440662-1ddd-4414-8c96-c52d1bdd0b84" returned: 0 in 0.585s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:10 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:53:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.272s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-669e12ed-9a08-4191-bb1c-f05d554f1071 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.080s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:10 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eb851f8-affd-4117-96c8-6088a32cea5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2440662-1ddd-4414-8c96-c52d1bdd0b84', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:10 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c87b093a-ea33-4de2-b03e-5e2f5da35095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:10 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-669e12ed-9a08-4191-bb1c-f05d554f1071 tempest-VolumesSnapshotTestJSON-1680973878 None] Creating offline snapshot 8a46bfa7-350b-4144-836c-aba0357a320b of volume 52560221-3fdb-48b2-b76f-72f286d5188d {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 15:53:10 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] Volume volume-f2440662-1ddd-4414-8c96-c52d1bdd0b84 (f2440662-1ddd-4414-8c96-c52d1bdd0b84): created successfully Apr 25 15:53:11 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c87b093a-ea33-4de2-b03e-5e2f5da35095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:11 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] Flow 'volume_create_manager' (7e702bd8-d4a8-4b0e-acc2-6e3e92daac04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:53:11 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e74e20d-47ae-49d9-bf17-c29344561de9]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:53:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-669e12ed-9a08-4191-bb1c-f05d554f1071 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:11 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-4a5b8be2-129b-414a-a9fe-9a19d9e9d390 tempest-VolumesListTestJSON-66795487 None] Created volume successfully. Apr 25 15:53:11 devstack sudo[87816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d Apr 25 15:53:11 devstack sudo[87816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:11 devstack sudo[87816]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-669e12ed-9a08-4191-bb1c-f05d554f1071 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d" returned: 0 in 0.526s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-669e12ed-9a08-4191-bb1c-f05d554f1071 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d.8a46bfa7-350b-4144-836c-aba0357a320b 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:11 devstack sudo[87822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d.8a46bfa7-350b-4144-836c-aba0357a320b 1G Apr 25 15:53:11 devstack sudo[87822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:11 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e2634adf-b173-4a1e-a43b-033d35a32a93 tempest-BackendsCapabilitiesAdminTestsJSON-269404985 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7188148498535, 'free_capacity_gb': 1775.7188148498535, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81828) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 25 15:53:12 devstack sudo[87822]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-669e12ed-9a08-4191-bb1c-f05d554f1071 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d.8a46bfa7-350b-4144-836c-aba0357a320b 1G" returned: 0 in 0.621s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-669e12ed-9a08-4191-bb1c-f05d554f1071 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52560221-3fdb-48b2-b76f-72f286d5188d -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d.8a46bfa7-350b-4144-836c-aba0357a320b {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:12 devstack sudo[87827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52560221-3fdb-48b2-b76f-72f286d5188d -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d.8a46bfa7-350b-4144-836c-aba0357a320b Apr 25 15:53:12 devstack sudo[87827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:12 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1d2136bc-85b5-406e-b124-c7fe4e224261 tempest-BackendsCapabilitiesAdminTestsJSON-269404985 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7188148498535, 'free_capacity_gb': 1775.7188148498535, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81828) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 25 15:53:12 devstack sudo[87827]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-669e12ed-9a08-4191-bb1c-f05d554f1071 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52560221-3fdb-48b2-b76f-72f286d5188d -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d.8a46bfa7-350b-4144-836c-aba0357a320b" returned: 0 in 0.513s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:12 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-669e12ed-9a08-4191-bb1c-f05d554f1071 tempest-VolumesSnapshotTestJSON-1680973878 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d.8a46bfa7-350b-4144-836c-aba0357a320b is being set with open permissions: ugo+rw Apr 25 15:53:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-669e12ed-9a08-4191-bb1c-f05d554f1071 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d.8a46bfa7-350b-4144-836c-aba0357a320b {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:12 devstack sudo[87832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d.8a46bfa7-350b-4144-836c-aba0357a320b Apr 25 15:53:12 devstack sudo[87832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:13 devstack sudo[87832]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-669e12ed-9a08-4191-bb1c-f05d554f1071 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d.8a46bfa7-350b-4144-836c-aba0357a320b" returned: 0 in 0.506s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-669e12ed-9a08-4191-bb1c-f05d554f1071 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:13 devstack sudo[87835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d.info Apr 25 15:53:13 devstack sudo[87835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:13 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c81995b4-9e21-48f0-ad15-4c420d52297f tempest-VolumesListTestJSON-66795487 None] Acquiring lock "cinder-f2440662-1ddd-4414-8c96-c52d1bdd0b84-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:53:13 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c81995b4-9e21-48f0-ad15-4c420d52297f tempest-VolumesListTestJSON-66795487 None] Lock "cinder-f2440662-1ddd-4414-8c96-c52d1bdd0b84-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:53:13 devstack sudo[87835]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-669e12ed-9a08-4191-bb1c-f05d554f1071 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d.info" returned: 0 in 0.592s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:13 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-669e12ed-9a08-4191-bb1c-f05d554f1071 tempest-VolumesSnapshotTestJSON-1680973878 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d.info is being set with open permissions: ugo+rw Apr 25 15:53:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-669e12ed-9a08-4191-bb1c-f05d554f1071 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:13 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c81995b4-9e21-48f0-ad15-4c420d52297f tempest-VolumesListTestJSON-66795487 None] Acquiring lock "cinder-quobyte-f2440662-1ddd-4414-8c96-c52d1bdd0b84" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:53:13 devstack sudo[87838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d.info Apr 25 15:53:13 devstack sudo[87838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:13 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c81995b4-9e21-48f0-ad15-4c420d52297f tempest-VolumesListTestJSON-66795487 None] Lock "cinder-quobyte-f2440662-1ddd-4414-8c96-c52d1bdd0b84" acquired by "delete_volume" :: waited 0.022s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:53:13 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4173632-877a-4d61-8511-a4315059bca2]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:53:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c81995b4-9e21-48f0-ad15-4c420d52297f tempest-VolumesListTestJSON-66795487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f2440662-1ddd-4414-8c96-c52d1bdd0b84 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:13 devstack sudo[87840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f2440662-1ddd-4414-8c96-c52d1bdd0b84 Apr 25 15:53:13 devstack sudo[87840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:14 devstack sudo[87838]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-669e12ed-9a08-4191-bb1c-f05d554f1071 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d.info" returned: 0 in 0.539s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-669e12ed-9a08-4191-bb1c-f05d554f1071 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.419s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:14 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-669e12ed-9a08-4191-bb1c-f05d554f1071 tempest-VolumesSnapshotTestJSON-1680973878 None] Create snapshot completed successfully Apr 25 15:53:14 devstack sudo[87840]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c81995b4-9e21-48f0-ad15-4c420d52297f tempest-VolumesListTestJSON-66795487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f2440662-1ddd-4414-8c96-c52d1bdd0b84" returned: 0 in 0.624s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c81995b4-9e21-48f0-ad15-4c420d52297f tempest-VolumesListTestJSON-66795487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f2440662-1ddd-4414-8c96-c52d1bdd0b84 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:14 devstack sudo[87846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f2440662-1ddd-4414-8c96-c52d1bdd0b84 Apr 25 15:53:14 devstack sudo[87846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:15 devstack sudo[87846]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c81995b4-9e21-48f0-ad15-4c420d52297f tempest-VolumesListTestJSON-66795487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f2440662-1ddd-4414-8c96-c52d1bdd0b84" returned: 0 in 0.510s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:15 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c81995b4-9e21-48f0-ad15-4c420d52297f tempest-VolumesListTestJSON-66795487 None] Lock "cinder-quobyte-f2440662-1ddd-4414-8c96-c52d1bdd0b84" released by "delete_volume" :: held 1.185s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:53:15 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-c81995b4-9e21-48f0-ad15-4c420d52297f tempest-VolumesListTestJSON-66795487 None] Created reservations ['6f1a6b22-cc82-4921-90b6-00b7d065af62', '246506f9-9059-4991-a522-43813f2b1899', 'f713dc86-24f2-49b2-b94d-6c4658eb2f4a', 'c1555127-6301-46df-838d-8ebb6a150471'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:53:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c81995b4-9e21-48f0-ad15-4c420d52297f tempest-VolumesListTestJSON-66795487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c81995b4-9e21-48f0-ad15-4c420d52297f tempest-VolumesListTestJSON-66795487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c81995b4-9e21-48f0-ad15-4c420d52297f tempest-VolumesListTestJSON-66795487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:53:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c81995b4-9e21-48f0-ad15-4c420d52297f tempest-VolumesListTestJSON-66795487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:53:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c81995b4-9e21-48f0-ad15-4c420d52297f tempest-VolumesListTestJSON-66795487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c81995b4-9e21-48f0-ad15-4c420d52297f tempest-VolumesListTestJSON-66795487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:15 devstack sudo[87849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:53:15 devstack sudo[87849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:15 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-0c6981ff-309c-4658-bcde-e3f0917fd477 tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "cinder-8a46bfa7-350b-4144-836c-aba0357a320b-delete_snapshot" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:53:15 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-0c6981ff-309c-4658-bcde-e3f0917fd477 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-8a46bfa7-350b-4144-836c-aba0357a320b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:53:15 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-0c6981ff-309c-4658-bcde-e3f0917fd477 tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "cinder-quobyte-52560221-3fdb-48b2-b76f-72f286d5188d" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:53:15 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-0c6981ff-309c-4658-bcde-e3f0917fd477 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-quobyte-52560221-3fdb-48b2-b76f-72f286d5188d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:53:15 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-0c6981ff-309c-4658-bcde-e3f0917fd477 tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "cinder-quobyte-8a46bfa7-350b-4144-836c-aba0357a320b" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:53:15 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-0c6981ff-309c-4658-bcde-e3f0917fd477 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-quobyte-8a46bfa7-350b-4144-836c-aba0357a320b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:53:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-0c6981ff-309c-4658-bcde-e3f0917fd477 tempest-VolumesSnapshotTestJSON-1680973878 None] Deleting offline snapshot 8a46bfa7-350b-4144-836c-aba0357a320b of volume 52560221-3fdb-48b2-b76f-72f286d5188d {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 15:53:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-0c6981ff-309c-4658-bcde-e3f0917fd477 tempest-VolumesSnapshotTestJSON-1680973878 None] snapshot_file for this snap is: volume-52560221-3fdb-48b2-b76f-72f286d5188d.8a46bfa7-350b-4144-836c-aba0357a320b {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 15:53:15 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd2fbf0-747e-4804-8868-0045882bafc0]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:53:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0c6981ff-309c-4658-bcde-e3f0917fd477 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d.8a46bfa7-350b-4144-836c-aba0357a320b {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:15 devstack sudo[87851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d.8a46bfa7-350b-4144-836c-aba0357a320b Apr 25 15:53:15 devstack sudo[87851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:15 devstack sudo[87849]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c81995b4-9e21-48f0-ad15-4c420d52297f tempest-VolumesListTestJSON-66795487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.539s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:15 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-c81995b4-9e21-48f0-ad15-4c420d52297f tempest-VolumesListTestJSON-66795487 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:53:15 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-c81995b4-9e21-48f0-ad15-4c420d52297f tempest-VolumesListTestJSON-66795487 None] Deleted volume successfully. Apr 25 15:53:15 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c81995b4-9e21-48f0-ad15-4c420d52297f tempest-VolumesListTestJSON-66795487 None] Lock "cinder-f2440662-1ddd-4414-8c96-c52d1bdd0b84-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:53:15 devstack sudo[87851]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0c6981ff-309c-4658-bcde-e3f0917fd477 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d.8a46bfa7-350b-4144-836c-aba0357a320b" returned: 0 in 0.619s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-0c6981ff-309c-4658-bcde-e3f0917fd477 tempest-VolumesSnapshotTestJSON-1680973878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52560221-3fdb-48b2-b76f-72f286d5188d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:53:15 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d211aa7-efa4-402f-b90e-fbb81337058f]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:53:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0c6981ff-309c-4658-bcde-e3f0917fd477 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:16 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5dd18299-2759-49f0-801a-ca2e2ad9acf1 tempest-VolumesListTestJSON-66795487 None] Acquiring lock "cinder-1d42f1d5-657c-4484-bc65-365ff0883b5e-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:53:16 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5dd18299-2759-49f0-801a-ca2e2ad9acf1 tempest-VolumesListTestJSON-66795487 None] Lock "cinder-1d42f1d5-657c-4484-bc65-365ff0883b5e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:53:16 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5dd18299-2759-49f0-801a-ca2e2ad9acf1 tempest-VolumesListTestJSON-66795487 None] Acquiring lock "cinder-quobyte-1d42f1d5-657c-4484-bc65-365ff0883b5e" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:53:16 devstack sudo[87857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d Apr 25 15:53:16 devstack sudo[87857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:16 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5dd18299-2759-49f0-801a-ca2e2ad9acf1 tempest-VolumesListTestJSON-66795487 None] Lock "cinder-quobyte-1d42f1d5-657c-4484-bc65-365ff0883b5e" acquired by "delete_volume" :: waited 0.019s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:53:16 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[359d21b3-ddef-4652-ab31-94ddbc147a1e]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:53:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5dd18299-2759-49f0-801a-ca2e2ad9acf1 tempest-VolumesListTestJSON-66795487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1d42f1d5-657c-4484-bc65-365ff0883b5e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:16 devstack sudo[87859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1d42f1d5-657c-4484-bc65-365ff0883b5e Apr 25 15:53:16 devstack sudo[87859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:16 devstack sudo[87857]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0c6981ff-309c-4658-bcde-e3f0917fd477 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d" returned: 0 in 0.685s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0c6981ff-309c-4658-bcde-e3f0917fd477 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d.8a46bfa7-350b-4144-836c-aba0357a320b {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:16 devstack sudo[87859]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5dd18299-2759-49f0-801a-ca2e2ad9acf1 tempest-VolumesListTestJSON-66795487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1d42f1d5-657c-4484-bc65-365ff0883b5e" returned: 0 in 0.556s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5dd18299-2759-49f0-801a-ca2e2ad9acf1 tempest-VolumesListTestJSON-66795487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1d42f1d5-657c-4484-bc65-365ff0883b5e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:16 devstack sudo[87867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d.8a46bfa7-350b-4144-836c-aba0357a320b Apr 25 15:53:16 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:16 devstack sudo[87868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1d42f1d5-657c-4484-bc65-365ff0883b5e Apr 25 15:53:16 devstack sudo[87868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:17 devstack sudo[87868]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5dd18299-2759-49f0-801a-ca2e2ad9acf1 tempest-VolumesListTestJSON-66795487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1d42f1d5-657c-4484-bc65-365ff0883b5e" returned: 0 in 0.533s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:17 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5dd18299-2759-49f0-801a-ca2e2ad9acf1 tempest-VolumesListTestJSON-66795487 None] Lock "cinder-quobyte-1d42f1d5-657c-4484-bc65-365ff0883b5e" released by "delete_volume" :: held 1.126s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:53:17 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0c6981ff-309c-4658-bcde-e3f0917fd477 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d.8a46bfa7-350b-4144-836c-aba0357a320b" returned: 0 in 0.625s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0c6981ff-309c-4658-bcde-e3f0917fd477 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d.8a46bfa7-350b-4144-836c-aba0357a320b {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:17 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-5dd18299-2759-49f0-801a-ca2e2ad9acf1 tempest-VolumesListTestJSON-66795487 None] Created reservations ['3db3c196-4f30-41b9-8f82-bf202827be6e', '8cbf8f8f-2abd-457e-9b46-27ee9bf4c9a1', 'e773a183-b4aa-4f0e-bd2d-b3b81e2ca45c', '88b87e57-5b57-40d1-b131-186ae0b5cd43'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:53:17 devstack sudo[87875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d.8a46bfa7-350b-4144-836c-aba0357a320b Apr 25 15:53:17 devstack sudo[87875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-5dd18299-2759-49f0-801a-ca2e2ad9acf1 tempest-VolumesListTestJSON-66795487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-5dd18299-2759-49f0-801a-ca2e2ad9acf1 tempest-VolumesListTestJSON-66795487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:17 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-5dd18299-2759-49f0-801a-ca2e2ad9acf1 tempest-VolumesListTestJSON-66795487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:53:17 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-5dd18299-2759-49f0-801a-ca2e2ad9acf1 tempest-VolumesListTestJSON-66795487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:53:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-5dd18299-2759-49f0-801a-ca2e2ad9acf1 tempest-VolumesListTestJSON-66795487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5dd18299-2759-49f0-801a-ca2e2ad9acf1 tempest-VolumesListTestJSON-66795487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:17 devstack sudo[87877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:53:17 devstack sudo[87877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:17 devstack sudo[87875]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0c6981ff-309c-4658-bcde-e3f0917fd477 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d.8a46bfa7-350b-4144-836c-aba0357a320b" returned: 0 in 0.516s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:17 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-0c6981ff-309c-4658-bcde-e3f0917fd477 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-quobyte-8a46bfa7-350b-4144-836c-aba0357a320b" released by "_delete_snapshot" :: held 2.553s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:53:17 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-0c6981ff-309c-4658-bcde-e3f0917fd477 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-quobyte-52560221-3fdb-48b2-b76f-72f286d5188d" released by "delete_snapshot" :: held 2.579s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:53:17 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-0c6981ff-309c-4658-bcde-e3f0917fd477 tempest-VolumesSnapshotTestJSON-1680973878 None] Created reservations ['b1dedd1f-884b-411c-abfd-9074595c388d', 'd2c81fc3-8bb3-4c65-ab29-4236c4855985', '1b1624a7-9075-4de4-8fdb-32150ae4aa7a', 'f978990e-1a07-4ec7-b1f3-a72693e4f7bb'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:53:17 devstack sudo[87877]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5dd18299-2759-49f0-801a-ca2e2ad9acf1 tempest-VolumesListTestJSON-66795487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.554s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:17 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-5dd18299-2759-49f0-801a-ca2e2ad9acf1 tempest-VolumesListTestJSON-66795487 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:53:17 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-5dd18299-2759-49f0-801a-ca2e2ad9acf1 tempest-VolumesListTestJSON-66795487 None] Deleted volume successfully. Apr 25 15:53:18 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-0c6981ff-309c-4658-bcde-e3f0917fd477 tempest-VolumesSnapshotTestJSON-1680973878 None] Delete snapshot completed successfully. Apr 25 15:53:18 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-0c6981ff-309c-4658-bcde-e3f0917fd477 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-8a46bfa7-350b-4144-836c-aba0357a320b-delete_snapshot" released by "delete_snapshot" :: held 2.807s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:53:18 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5dd18299-2759-49f0-801a-ca2e2ad9acf1 tempest-VolumesListTestJSON-66795487 None] Lock "cinder-1d42f1d5-657c-4484-bc65-365ff0883b5e-delete_volume" released by "delete_volume" :: held 1.951s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:53:18 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-81c600f9-83f1-499b-a0a9-377cdd3011f5 tempest-VolumesListTestJSON-66795487 None] Acquiring lock "cinder-56f855a9-7b16-4576-9a18-0d90e5c0c49e-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:53:18 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-81c600f9-83f1-499b-a0a9-377cdd3011f5 tempest-VolumesListTestJSON-66795487 None] Lock "cinder-56f855a9-7b16-4576-9a18-0d90e5c0c49e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:53:18 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-81c600f9-83f1-499b-a0a9-377cdd3011f5 tempest-VolumesListTestJSON-66795487 None] Acquiring lock "cinder-quobyte-56f855a9-7b16-4576-9a18-0d90e5c0c49e" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:53:18 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-81c600f9-83f1-499b-a0a9-377cdd3011f5 tempest-VolumesListTestJSON-66795487 None] Lock "cinder-quobyte-56f855a9-7b16-4576-9a18-0d90e5c0c49e" acquired by "delete_volume" :: waited 0.019s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:53:18 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15b03a4-ffc6-4b4b-a49f-56f821e2c514]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:53:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-81c600f9-83f1-499b-a0a9-377cdd3011f5 tempest-VolumesListTestJSON-66795487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-56f855a9-7b16-4576-9a18-0d90e5c0c49e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:18 devstack sudo[87881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-56f855a9-7b16-4576-9a18-0d90e5c0c49e Apr 25 15:53:18 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:18 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:53:18 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] Flow 'volume_create_manager' (6206c0b9-34dd-4d21-9526-1072c91bf901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:53:18 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e8c5ed-ca61-447c-babe-a0b71305d934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e8c5ed-ca61-447c-babe-a0b71305d934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1272230382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff0ec0d6-6438-46fc-8c47-05d6494a6953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4db9c91c22c146dc83a399cfea0a4c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:53:19Z,use_quota=True,user_id='90f6adadb99a4c8485b48ebbc5672c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67df8c69-0d3c-44a0-930a-9afead309f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67df8c69-0d3c-44a0-930a-9afead309f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (533eae62-6459-4875-8b00-1540184df720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (533eae62-6459-4875-8b00-1540184df720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff0ec0d6-6438-46fc-8c47-05d6494a6953', 'volume_name': 'volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb11c2eb-ac10-4614-ad53-38b47bd5c06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb11c2eb-ac10-4614-ad53-38b47bd5c06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096f4a2b-228e-4328-8bc9-95c95e1f317c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:19 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] Volume ff0ec0d6-6438-46fc-8c47-05d6494a6953: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953', 'volume_size': 1} Apr 25 15:53:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1272230382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff0ec0d6-6438-46fc-8c47-05d6494a6953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4db9c91c22c146dc83a399cfea0a4c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:53:19Z,use_quota=True,user_id='90f6adadb99a4c8485b48ebbc5672c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:53:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] Creating volume ff0ec0d6-6438-46fc-8c47-05d6494a6953 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:53:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:53:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:53:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:53:19 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:53:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:19 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:19 devstack sudo[87886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953 1073741824 Apr 25 15:53:19 devstack sudo[87886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-81c600f9-83f1-499b-a0a9-377cdd3011f5 tempest-VolumesListTestJSON-66795487 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-56f855a9-7b16-4576-9a18-0d90e5c0c49e" returned: 0 in 0.638s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-81c600f9-83f1-499b-a0a9-377cdd3011f5 tempest-VolumesListTestJSON-66795487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-56f855a9-7b16-4576-9a18-0d90e5c0c49e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:19 devstack sudo[87888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-56f855a9-7b16-4576-9a18-0d90e5c0c49e Apr 25 15:53:19 devstack sudo[87888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:19 devstack sudo[87888]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-81c600f9-83f1-499b-a0a9-377cdd3011f5 tempest-VolumesListTestJSON-66795487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-56f855a9-7b16-4576-9a18-0d90e5c0c49e" returned: 0 in 0.599s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:19 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-81c600f9-83f1-499b-a0a9-377cdd3011f5 tempest-VolumesListTestJSON-66795487 None] Lock "cinder-quobyte-56f855a9-7b16-4576-9a18-0d90e5c0c49e" released by "delete_volume" :: held 1.282s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:53:19 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-81c600f9-83f1-499b-a0a9-377cdd3011f5 tempest-VolumesListTestJSON-66795487 None] Created reservations ['aa7b26c8-f387-4ce8-b04a-28bd2d1aa4c8', '6b55c0b1-5064-438e-9638-c85e16e2d1f8', '74fd0fe2-04a8-438a-998d-717f6ea7907c', '5912d976-d32d-45e7-b4fb-681ba2b513b3'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:53:19 devstack sudo[87886]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953 1073741824" returned: 0 in 0.742s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-81c600f9-83f1-499b-a0a9-377cdd3011f5 tempest-VolumesListTestJSON-66795487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-81c600f9-83f1-499b-a0a9-377cdd3011f5 tempest-VolumesListTestJSON-66795487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-81c600f9-83f1-499b-a0a9-377cdd3011f5 tempest-VolumesListTestJSON-66795487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:53:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-81c600f9-83f1-499b-a0a9-377cdd3011f5 tempest-VolumesListTestJSON-66795487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:53:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-81c600f9-83f1-499b-a0a9-377cdd3011f5 tempest-VolumesListTestJSON-66795487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-81c600f9-83f1-499b-a0a9-377cdd3011f5 tempest-VolumesListTestJSON-66795487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:19 devstack sudo[87894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:53:19 devstack sudo[87894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:19 devstack sudo[87896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953 Apr 25 15:53:19 devstack sudo[87896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:20 devstack sudo[87894]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-81c600f9-83f1-499b-a0a9-377cdd3011f5 tempest-VolumesListTestJSON-66795487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.494s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:20 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-81c600f9-83f1-499b-a0a9-377cdd3011f5 tempest-VolumesListTestJSON-66795487 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:53:20 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-81c600f9-83f1-499b-a0a9-377cdd3011f5 tempest-VolumesListTestJSON-66795487 None] Deleted volume successfully. Apr 25 15:53:20 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-81c600f9-83f1-499b-a0a9-377cdd3011f5 tempest-VolumesListTestJSON-66795487 None] Lock "cinder-56f855a9-7b16-4576-9a18-0d90e5c0c49e-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:53:20 devstack sudo[87896]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953" returned: 0 in 0.541s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:20 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:53:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (096f4a2b-228e-4328-8bc9-95c95e1f317c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b6bd5a-c461-4eb7-b0a5-4c2294d377b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:20 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] Volume volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953 (ff0ec0d6-6438-46fc-8c47-05d6494a6953): created successfully Apr 25 15:53:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52b6bd5a-c461-4eb7-b0a5-4c2294d377b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] Flow 'volume_create_manager' (6206c0b9-34dd-4d21-9526-1072c91bf901) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:53:20 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-06795f37-1aa8-470c-924a-bf0610baf068 tempest-VolumesSnapshotTestJSON-1680973878 None] Created volume successfully. Apr 25 15:53:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b5245309-8d36-4d1f-bc9e-418ebd8c57b9 tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b5245309-8d36-4d1f-bc9e-418ebd8c57b9 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:21 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-b5245309-8d36-4d1f-bc9e-418ebd8c57b9 tempest-VolumesSnapshotTestJSON-1680973878 None] Creating offline snapshot 1784751a-2776-4f15-b85a-aae6445af1da of volume ff0ec0d6-6438-46fc-8c47-05d6494a6953 {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 15:53:21 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[14be2bcc-e34c-4e79-ad34-56a86cb6caa2]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:53:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b5245309-8d36-4d1f-bc9e-418ebd8c57b9 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:21 devstack sudo[87901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953 Apr 25 15:53:21 devstack sudo[87901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:21 devstack sudo[87901]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b5245309-8d36-4d1f-bc9e-418ebd8c57b9 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953" returned: 0 in 0.632s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b5245309-8d36-4d1f-bc9e-418ebd8c57b9 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953.1784751a-2776-4f15-b85a-aae6445af1da 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:22 devstack sudo[87906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953.1784751a-2776-4f15-b85a-aae6445af1da 1G Apr 25 15:53:22 devstack sudo[87906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:22 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-bd872ae0-f108-4e3c-9610-1cb301f77bc3 tempest-GroupsTest-637970300 None] Group tempest-Group1-103870320: creating Apr 25 15:53:22 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-bd872ae0-f108-4e3c-9610-1cb301f77bc3 tempest-GroupsTest-637970300 None] Group tempest-Group1-103870320: created successfully Apr 25 15:53:22 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-bd872ae0-f108-4e3c-9610-1cb301f77bc3 tempest-GroupsTest-637970300 None] Create group completed successfully. Apr 25 15:53:22 devstack sudo[87906]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b5245309-8d36-4d1f-bc9e-418ebd8c57b9 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953.1784751a-2776-4f15-b85a-aae6445af1da 1G" returned: 0 in 0.679s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b5245309-8d36-4d1f-bc9e-418ebd8c57b9 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953.1784751a-2776-4f15-b85a-aae6445af1da {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:22 devstack sudo[87911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953.1784751a-2776-4f15-b85a-aae6445af1da Apr 25 15:53:22 devstack sudo[87911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:23 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:53:23 devstack sudo[87911]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:23 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] Flow 'volume_create_manager' (86274b71-28e2-4961-b4cc-da5ca954d39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:53:23 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd800060-6080-4837-b632-975fc9b3be39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b5245309-8d36-4d1f-bc9e-418ebd8c57b9 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953.1784751a-2776-4f15-b85a-aae6445af1da" returned: 0 in 0.554s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:23 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-b5245309-8d36-4d1f-bc9e-418ebd8c57b9 tempest-VolumesSnapshotTestJSON-1680973878 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953.1784751a-2776-4f15-b85a-aae6445af1da is being set with open permissions: ugo+rw Apr 25 15:53:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b5245309-8d36-4d1f-bc9e-418ebd8c57b9 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953.1784751a-2776-4f15-b85a-aae6445af1da {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:23 devstack sudo[87916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953.1784751a-2776-4f15-b85a-aae6445af1da Apr 25 15:53:23 devstack sudo[87916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:23 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd800060-6080-4837-b632-975fc9b3be39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c287da82-7fb7-4b5e-a720-fdef95fd666b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca03470c46dd476cb81684a1705a494f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:53:23Z,use_quota=True,user_id='44daead78cb747939a8df99f3acca79d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:23 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a9b7617-4119-45e7-8354-5291096a4ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:23 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a9b7617-4119-45e7-8354-5291096a4ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:23 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5656ab40-febd-4d6b-a00c-45fdfb3cad70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:23 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5656ab40-febd-4d6b-a00c-45fdfb3cad70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c287da82-7fb7-4b5e-a720-fdef95fd666b', 'volume_name': 'volume-c287da82-7fb7-4b5e-a720-fdef95fd666b', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:23 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9860ff4-e922-4fed-8cb5-6b5fc26cb6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:23 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9860ff4-e922-4fed-8cb5-6b5fc26cb6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:23 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93d8585b-61e2-4b13-bf4e-ee321c46e716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:23 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] Volume c287da82-7fb7-4b5e-a720-fdef95fd666b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c287da82-7fb7-4b5e-a720-fdef95fd666b', 'volume_size': 1} Apr 25 15:53:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:23 devstack sudo[87916]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b5245309-8d36-4d1f-bc9e-418ebd8c57b9 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953.1784751a-2776-4f15-b85a-aae6445af1da" returned: 0 in 0.432s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b5245309-8d36-4d1f-bc9e-418ebd8c57b9 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:23 devstack sudo[87919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953.info Apr 25 15:53:23 devstack sudo[87919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:23 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-c27a2f24-6ce8-43bc-84e5-e5429310d3f3 tempest-GroupsTest-637970300 None] Group tempest-Group2-1459782399: creating Apr 25 15:53:23 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-c27a2f24-6ce8-43bc-84e5-e5429310d3f3 tempest-GroupsTest-637970300 None] Group tempest-Group2-1459782399: created successfully Apr 25 15:53:23 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-c27a2f24-6ce8-43bc-84e5-e5429310d3f3 tempest-GroupsTest-637970300 None] Create group completed successfully. Apr 25 15:53:24 devstack sudo[87919]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b5245309-8d36-4d1f-bc9e-418ebd8c57b9 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953.info" returned: 0 in 0.467s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:24 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-b5245309-8d36-4d1f-bc9e-418ebd8c57b9 tempest-VolumesSnapshotTestJSON-1680973878 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953.info is being set with open permissions: ugo+rw Apr 25 15:53:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b5245309-8d36-4d1f-bc9e-418ebd8c57b9 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:24 devstack sudo[87922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953.info Apr 25 15:53:24 devstack sudo[87922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:24 devstack sudo[87922]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b5245309-8d36-4d1f-bc9e-418ebd8c57b9 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953.info" returned: 0 in 0.444s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b5245309-8d36-4d1f-bc9e-418ebd8c57b9 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.308s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.350s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:24 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c287da82-7fb7-4b5e-a720-fdef95fd666b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca03470c46dd476cb81684a1705a494f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:53:23Z,use_quota=True,user_id='44daead78cb747939a8df99f3acca79d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:53:24 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] Creating volume c287da82-7fb7-4b5e-a720-fdef95fd666b {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:53:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:24 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:53:24 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:53:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:24 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:53:24 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:53:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c287da82-7fb7-4b5e-a720-fdef95fd666b 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:24 devstack sudo[87925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c287da82-7fb7-4b5e-a720-fdef95fd666b 1073741824 Apr 25 15:53:24 devstack sudo[87925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:24 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-b5245309-8d36-4d1f-bc9e-418ebd8c57b9 tempest-VolumesSnapshotTestJSON-1680973878 None] Create snapshot completed successfully Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] Flow 'volume_create_manager' (70e4a082-500f-48ef-b70d-99174b0f3d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0979c72-8031-4073-926a-d862e80df19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0979c72-8031-4073-926a-d862e80df19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-252535810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0569501b-9eca-47ff-897b-0f14206e4108,host='devstack@QuobyteHD#QuobyteHD',id=ed045a14-a410-41ce-b80d-774e6b4d2783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed1133e7868a400ea606550625b00db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:53:25Z,use_quota=True,user_id='f972deb3b56b4cf181d0168753c64304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce1c112a-652b-4650-8518-8c503c7b16d0),volume_type_id=ce1c112a-652b-4650-8518-8c503c7b16d0)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca02aeb6-76de-4894-b465-2e42559ba49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca02aeb6-76de-4894-b465-2e42559ba49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (550d11b0-9906-42c7-a8ec-94d5bc9f448d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (550d11b0-9906-42c7-a8ec-94d5bc9f448d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed045a14-a410-41ce-b80d-774e6b4d2783', 'volume_name': 'volume-ed045a14-a410-41ce-b80d-774e6b4d2783', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a72bc6-8657-4dcc-81ca-e47127524503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a72bc6-8657-4dcc-81ca-e47127524503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9792a16d-94b6-4abe-9186-c6949fc37cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:25 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] Volume ed045a14-a410-41ce-b80d-774e6b4d2783: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed045a14-a410-41ce-b80d-774e6b4d2783', 'volume_size': 1} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:25 devstack sudo[87925]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c287da82-7fb7-4b5e-a720-fdef95fd666b 1073741824" returned: 0 in 0.701s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c287da82-7fb7-4b5e-a720-fdef95fd666b {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:25 devstack sudo[87930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c287da82-7fb7-4b5e-a720-fdef95fd666b Apr 25 15:53:25 devstack sudo[87930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Flow 'volume_create_manager' (4e2fc750-2425-4b0e-ac90-57385941133d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:53:25 devstack sudo[87930]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d35724-40d6-48a3-b338-1b412d31ce63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c287da82-7fb7-4b5e-a720-fdef95fd666b" returned: 0 in 0.496s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.532s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0569501b-9eca-47ff-897b-0f14206e4108,created_at=2026-04-25T13:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-252535810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0569501b-9eca-47ff-897b-0f14206e4108,host='devstack@QuobyteHD#QuobyteHD',id=ed045a14-a410-41ce-b80d-774e6b4d2783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed1133e7868a400ea606550625b00db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:53:25Z,use_quota=True,user_id='f972deb3b56b4cf181d0168753c64304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce1c112a-652b-4650-8518-8c503c7b16d0),volume_type_id=ce1c112a-652b-4650-8518-8c503c7b16d0)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] Creating volume ed045a14-a410-41ce-b80d-774e6b4d2783 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:53:25 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ed045a14-a410-41ce-b80d-774e6b4d2783 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d35724-40d6-48a3-b338-1b412d31ce63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:53:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1743633236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72f9594b-eec1-4ab0-9278-ecc719b3ff06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4db9c91c22c146dc83a399cfea0a4c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:53:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=1784751a-2776-4f15-b85a-aae6445af1da,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:53:26Z,use_quota=True,user_id='90f6adadb99a4c8485b48ebbc5672c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:25 devstack sudo[87933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ed045a14-a410-41ce-b80d-774e6b4d2783 1073741824 Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57faaab7-72db-4155-b6ed-549236b36227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:25 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57faaab7-72db-4155-b6ed-549236b36227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a755dc39-cf1f-4f11-b4b3-a309797a55a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a755dc39-cf1f-4f11-b4b3-a309797a55a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '72f9594b-eec1-4ab0-9278-ecc719b3ff06', 'volume_name': 'volume-72f9594b-eec1-4ab0-9278-ecc719b3ff06', 'volume_size': 2, 'snapshot_id': '1784751a-2776-4f15-b85a-aae6445af1da'}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e5bf9e-0a54-4cd8-a59a-54f10cda116f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e5bf9e-0a54-4cd8-a59a-54f10cda116f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (815f8140-41e5-4629-af05-8a65e07b4f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:25 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Volume 72f9594b-eec1-4ab0-9278-ecc719b3ff06: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-72f9594b-eec1-4ab0-9278-ecc719b3ff06', 'volume_size': 2, 'snapshot_id': '1784751a-2776-4f15-b85a-aae6445af1da'} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93d8585b-61e2-4b13-bf4e-ee321c46e716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c287da82-7fb7-4b5e-a720-fdef95fd666b', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c93a84fa-f24b-430b-8fe9-4738b1fec665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:25 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] Volume volume-c287da82-7fb7-4b5e-a720-fdef95fd666b (c287da82-7fb7-4b5e-a720-fdef95fd666b): created successfully Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c93a84fa-f24b-430b-8fe9-4738b1fec665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] Flow 'volume_create_manager' (86274b71-28e2-4961-b4cc-da5ca954d39c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:53:25 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-fb2da1db-57ad-4e47-ad2a-8706aab9485e tempest-CinderUnicodeTest-1487377300 None] Created volume successfully. Apr 25 15:53:26 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ed045a14-a410-41ce-b80d-774e6b4d2783 1073741824" returned: 0 in 0.703s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ed045a14-a410-41ce-b80d-774e6b4d2783 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:26 devstack sudo[87939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ed045a14-a410-41ce-b80d-774e6b4d2783 Apr 25 15:53:26 devstack sudo[87939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:26 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:53:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] Flow 'volume_create_manager' (16dcb057-511d-4667-b60f-500e4fccd965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:53:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956fde0e-7b99-417e-a2ee-ea9697b8f082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956fde0e-7b99-417e-a2ee-ea9697b8f082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:53:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-437716837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d4e4385-e58d-473e-9cb0-934bc7b9b4eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca03470c46dd476cb81684a1705a494f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:53:27Z,use_quota=True,user_id='44daead78cb747939a8df99f3acca79d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1776a0dc-98d3-4abe-8533-45f571512ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1776a0dc-98d3-4abe-8533-45f571512ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e4e75b5-aa19-44e6-ab5f-724e5c0c24fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e4e75b5-aa19-44e6-ab5f-724e5c0c24fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d4e4385-e58d-473e-9cb0-934bc7b9b4eb', 'volume_name': 'volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (059b21e5-daf6-4277-8f14-3a902fe30493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (059b21e5-daf6-4277-8f14-3a902fe30493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0eac117-ff50-4da7-a36c-6645088bbc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:26 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] Volume 9d4e4385-e58d-473e-9cb0-934bc7b9b4eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb', 'volume_size': 1} Apr 25 15:53:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:27 devstack sudo[87939]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ed045a14-a410-41ce-b80d-774e6b4d2783" returned: 0 in 0.523s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.205s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "cinder-quobyte-1784751a-2776-4f15-b85a-aae6445af1da-72f9594b-eec1-4ab0-9278-ecc719b3ff06" by "_create_volume_from_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9792a16d-94b6-4abe-9186-c6949fc37cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed045a14-a410-41ce-b80d-774e6b4d2783', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b4d979-3690-4dae-a3fa-03e3ae3f6baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-quobyte-1784751a-2776-4f15-b85a-aae6445af1da-72f9594b-eec1-4ab0-9278-ecc719b3ff06" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Creating volume 72f9594b-eec1-4ab0-9278-ecc719b3ff06 from snapshot 1784751a-2776-4f15-b85a-aae6445af1da {{(pid=81828) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "cinder-quobyte-72f9594b-eec1-4ab0-9278-ecc719b3ff06" by "_copy_volume_from_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:53:27 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] Volume volume-ed045a14-a410-41ce-b80d-774e6b4d2783 (ed045a14-a410-41ce-b80d-774e6b4d2783): created successfully Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43b4d979-3690-4dae-a3fa-03e3ae3f6baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] Flow 'volume_create_manager' (70e4a082-500f-48ef-b70d-99174b0f3d99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-quobyte-72f9594b-eec1-4ab0-9278-ecc719b3ff06" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] snapshot: 1784751a-2776-4f15-b85a-aae6445af1da, volume: 72f9594b-eec1-4ab0-9278-ecc719b3ff06, {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 25 15:53:27 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-55709acc-3ff1-4064-ac09-23cc5ef86335 tempest-GroupsTest-637970300 None] Created volume successfully. Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d447d9-b2a7-47c8-916c-dba02fbfe79b]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953.1784751a-2776-4f15-b85a-aae6445af1da {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:27 devstack sudo[87943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953.1784751a-2776-4f15-b85a-aae6445af1da Apr 25 15:53:27 devstack sudo[87943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:27 devstack sudo[87943]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953.1784751a-2776-4f15-b85a-aae6445af1da" returned: 0 in 0.532s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] will copy from snapshot at /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953 {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Creating direct copy from snapshot {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[999e630f-365a-47de-bdf9-4341e4820cad]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5210de76-5929-4238-8d39-569225d41aaa tempest-GroupsTest-637970300 None] Acquiring lock "cinder-quobyte-ed045a14-a410-41ce-b80d-774e6b4d2783" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5210de76-5929-4238-8d39-569225d41aaa tempest-GroupsTest-637970300 None] Lock "cinder-quobyte-ed045a14-a410-41ce-b80d-774e6b4d2783" acquired by "delete_volume" :: waited 0.022s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[527d0c87-242c-4f79-9eb0-4a1cc26247be]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:53:27 devstack sudo[87948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953 Apr 25 15:53:27 devstack sudo[87948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5210de76-5929-4238-8d39-569225d41aaa tempest-GroupsTest-637970300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ed045a14-a410-41ce-b80d-774e6b4d2783 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:28 devstack sudo[87950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ed045a14-a410-41ce-b80d-774e6b4d2783 Apr 25 15:53:28 devstack sudo[87950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:28 devstack sudo[87948]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953" returned: 0 in 0.557s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:28 devstack cinder-volume[81828]: DEBUG cinder.utils [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Path /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72f9594b-eec1-4ab0-9278-ecc719b3ff06 not found in is_blk_device check {{(pid=81828) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 25 15:53:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72f9594b-eec1-4ab0-9278-ecc719b3ff06 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:28 devstack sudo[87958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72f9594b-eec1-4ab0-9278-ecc719b3ff06 Apr 25 15:53:28 devstack sudo[87958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:28 devstack sudo[87950]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5210de76-5929-4238-8d39-569225d41aaa tempest-GroupsTest-637970300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ed045a14-a410-41ce-b80d-774e6b4d2783" returned: 0 in 0.524s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5210de76-5929-4238-8d39-569225d41aaa tempest-GroupsTest-637970300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ed045a14-a410-41ce-b80d-774e6b4d2783 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:28 devstack sudo[87960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ed045a14-a410-41ce-b80d-774e6b4d2783 Apr 25 15:53:28 devstack sudo[87960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:28 devstack sudo[87960]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5210de76-5929-4238-8d39-569225d41aaa tempest-GroupsTest-637970300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ed045a14-a410-41ce-b80d-774e6b4d2783" returned: 0 in 0.489s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:28 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5210de76-5929-4238-8d39-569225d41aaa tempest-GroupsTest-637970300 None] Lock "cinder-quobyte-ed045a14-a410-41ce-b80d-774e6b4d2783" released by "delete_volume" :: held 1.057s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:53:29 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-5210de76-5929-4238-8d39-569225d41aaa tempest-GroupsTest-637970300 None] Created reservations ['adb3459e-a49d-44b6-9e19-9ef764f3613d'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:53:29 devstack cinder-volume[81828]: WARNING cinder.quota [None req-5210de76-5929-4238-8d39-569225d41aaa tempest-GroupsTest-637970300 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2144355183 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2144355183, it is now deprecated. Please use the default quota class for default quota. Apr 25 15:53:29 devstack cinder-volume[81828]: WARNING cinder.quota [None req-5210de76-5929-4238-8d39-569225d41aaa tempest-GroupsTest-637970300 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2144355183 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2144355183, it is now deprecated. Please use the default quota class for default quota. Apr 25 15:53:29 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-5210de76-5929-4238-8d39-569225d41aaa tempest-GroupsTest-637970300 None] Created reservations ['20290ccf-6d1e-415f-9499-aa820e932030', '857489db-66d3-4a98-919d-b678bf3867f7', '6e89008d-b77d-453b-95b1-5e3aae341f23', 'eae3e34c-f9e0-4091-b3e9-449dfedf20ee'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:53:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-5210de76-5929-4238-8d39-569225d41aaa tempest-GroupsTest-637970300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-5210de76-5929-4238-8d39-569225d41aaa tempest-GroupsTest-637970300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:29 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-5210de76-5929-4238-8d39-569225d41aaa tempest-GroupsTest-637970300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:53:29 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-5210de76-5929-4238-8d39-569225d41aaa tempest-GroupsTest-637970300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:53:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-5210de76-5929-4238-8d39-569225d41aaa tempest-GroupsTest-637970300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5210de76-5929-4238-8d39-569225d41aaa tempest-GroupsTest-637970300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:29 devstack sudo[87973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:53:29 devstack sudo[87973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:30 devstack sudo[87973]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5210de76-5929-4238-8d39-569225d41aaa tempest-GroupsTest-637970300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.755s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:30 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-5210de76-5929-4238-8d39-569225d41aaa tempest-GroupsTest-637970300 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:53:30 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-5210de76-5929-4238-8d39-569225d41aaa tempest-GroupsTest-637970300 None] Delete group completed successfully. Apr 25 15:53:30 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-08ef987d-74ee-40af-8620-f283d60dcbe2 tempest-GroupsTest-637970300 None] Created reservations ['c82b780a-eefc-4bc3-8dc7-d0e1e4ef5f16'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:53:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-08ef987d-74ee-40af-8620-f283d60dcbe2 tempest-GroupsTest-637970300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-08ef987d-74ee-40af-8620-f283d60dcbe2 tempest-GroupsTest-637970300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-08ef987d-74ee-40af-8620-f283d60dcbe2 tempest-GroupsTest-637970300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:53:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-08ef987d-74ee-40af-8620-f283d60dcbe2 tempest-GroupsTest-637970300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:53:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-08ef987d-74ee-40af-8620-f283d60dcbe2 tempest-GroupsTest-637970300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-08ef987d-74ee-40af-8620-f283d60dcbe2 tempest-GroupsTest-637970300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:30 devstack sudo[87976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:53:30 devstack sudo[87976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:31 devstack sudo[87976]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-08ef987d-74ee-40af-8620-f283d60dcbe2 tempest-GroupsTest-637970300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.974s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:31 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-08ef987d-74ee-40af-8620-f283d60dcbe2 tempest-GroupsTest-637970300 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:53:31 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-08ef987d-74ee-40af-8620-f283d60dcbe2 tempest-GroupsTest-637970300 None] Delete group completed successfully. Apr 25 15:53:32 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-3ccf7acc-7e53-44ee-bee9-bba4437ac10f tempest-GroupsTest-637970300 None] Group tempest-GroupsTest-Group-388349330: creating Apr 25 15:53:32 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-3ccf7acc-7e53-44ee-bee9-bba4437ac10f tempest-GroupsTest-637970300 None] Group tempest-GroupsTest-Group-388349330: created successfully Apr 25 15:53:32 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-3ccf7acc-7e53-44ee-bee9-bba4437ac10f tempest-GroupsTest-637970300 None] Create group completed successfully. Apr 25 15:53:33 devstack sudo[87958]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72f9594b-eec1-4ab0-9278-ecc719b3ff06" returned: 0 in 4.997s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:33 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9024682-71d4-4b61-9d7c-f43f51112967]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:53:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:33 devstack sudo[87980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953 Apr 25 15:53:33 devstack sudo[87980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:33 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:53:33 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] Flow 'volume_create_manager' (ef77eaef-a953-4605-bbab-6ba1639abfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:53:33 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a21d5ce2-9eb0-4d7d-bf1f-0533c2e8da98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:33 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a21d5ce2-9eb0-4d7d-bf1f-0533c2e8da98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-879876076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=faed51e2-4cf0-41d2-a095-1ba00877c9e8,host='devstack@QuobyteHD#QuobyteHD',id=97fb2ae2-c221-43e8-bb4b-475520315e75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed1133e7868a400ea606550625b00db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:53:34Z,use_quota=True,user_id='f972deb3b56b4cf181d0168753c64304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4087d5-7c60-4b19-8165-12fda46a1b51),volume_type_id=0d4087d5-7c60-4b19-8165-12fda46a1b51)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:33 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dd45942-872d-4294-91fc-0febc937818f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:33 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dd45942-872d-4294-91fc-0febc937818f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:33 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3345da1b-568e-45cf-a746-b8bb5f4db0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:33 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3345da1b-568e-45cf-a746-b8bb5f4db0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97fb2ae2-c221-43e8-bb4b-475520315e75', 'volume_name': 'volume-97fb2ae2-c221-43e8-bb4b-475520315e75', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:33 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a8df0ef-e5b3-45b9-b844-d1738518109a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:33 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a8df0ef-e5b3-45b9-b844-d1738518109a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:33 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9dcf370-82f1-4434-bada-aba123a5bbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:33 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] Volume 97fb2ae2-c221-43e8-bb4b-475520315e75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97fb2ae2-c221-43e8-bb4b-475520315e75', 'volume_size': 1} Apr 25 15:53:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:34 devstack sudo[87980]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953" returned: 0 in 0.682s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:34 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Image conversion details: src /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953, size 1024.00 MB, duration 5.00 sec, destination /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72f9594b-eec1-4ab0-9278-ecc719b3ff06 {{(pid=81828) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 15:53:34 devstack cinder-volume[81828]: INFO cinder.image.image_utils [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Converted 1024.00 MB image at 204.89 MB/s Apr 25 15:53:34 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72f9594b-eec1-4ab0-9278-ecc719b3ff06 is being set with open permissions: ugo+rw Apr 25 15:53:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72f9594b-eec1-4ab0-9278-ecc719b3ff06 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:34 devstack sudo[87985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72f9594b-eec1-4ab0-9278-ecc719b3ff06 Apr 25 15:53:34 devstack sudo[87985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:34 devstack sudo[87985]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72f9594b-eec1-4ab0-9278-ecc719b3ff06" returned: 0 in 0.470s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:34 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-quobyte-72f9594b-eec1-4ab0-9278-ecc719b3ff06" released by "_copy_volume_from_snapshot" :: held 7.353s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:53:34 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-quobyte-1784751a-2776-4f15-b85a-aae6445af1da-72f9594b-eec1-4ab0-9278-ecc719b3ff06" released by "_create_volume_from_snapshot" :: held 7.397s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:53:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.425s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.671s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:34 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:53:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-437716837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d4e4385-e58d-473e-9cb0-934bc7b9b4eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca03470c46dd476cb81684a1705a494f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:53:27Z,use_quota=True,user_id='44daead78cb747939a8df99f3acca79d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:53:34 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] Creating volume 9d4e4385-e58d-473e-9cb0-934bc7b9b4eb {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:53:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:34 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:53:34 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:53:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:34 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:53:34 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:53:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:34 devstack sudo[87988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb 1073741824 Apr 25 15:53:34 devstack sudo[87988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:34 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (815f8140-41e5-4629-af05-8a65e07b4f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72f9594b-eec1-4ab0-9278-ecc719b3ff06', 'volume_size': 2, 'snapshot_id': '1784751a-2776-4f15-b85a-aae6445af1da'}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:34 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887ba2fb-6927-46d3-8068-a2f527f886df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:34 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Volume volume-72f9594b-eec1-4ab0-9278-ecc719b3ff06 (72f9594b-eec1-4ab0-9278-ecc719b3ff06): created successfully Apr 25 15:53:34 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (887ba2fb-6927-46d3-8068-a2f527f886df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:34 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Flow 'volume_create_manager' (4e2fc750-2425-4b0e-ac90-57385941133d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:53:34 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-f565bcc2-5f7b-462a-a016-ab03a913a29d tempest-VolumesSnapshotTestJSON-1680973878 None] Created volume successfully. Apr 25 15:53:35 devstack sudo[87988]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb 1073741824" returned: 0 in 0.620s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:35 devstack sudo[87993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb Apr 25 15:53:35 devstack sudo[87993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:35 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3ed93f3d-73d7-441c-86ce-3a43d70b80da tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "cinder-72f9594b-eec1-4ab0-9278-ecc719b3ff06-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:53:35 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3ed93f3d-73d7-441c-86ce-3a43d70b80da tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-72f9594b-eec1-4ab0-9278-ecc719b3ff06-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:53:35 devstack sudo[87993]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb" returned: 0 in 0.476s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:35 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3ed93f3d-73d7-441c-86ce-3a43d70b80da tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "cinder-quobyte-72f9594b-eec1-4ab0-9278-ecc719b3ff06" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:53:35 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:53:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.825s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:35 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=faed51e2-4cf0-41d2-a095-1ba00877c9e8,created_at=2026-04-25T13:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-879876076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=faed51e2-4cf0-41d2-a095-1ba00877c9e8,host='devstack@QuobyteHD#QuobyteHD',id=97fb2ae2-c221-43e8-bb4b-475520315e75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed1133e7868a400ea606550625b00db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:53:34Z,use_quota=True,user_id='f972deb3b56b4cf181d0168753c64304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4087d5-7c60-4b19-8165-12fda46a1b51),volume_type_id=0d4087d5-7c60-4b19-8165-12fda46a1b51)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:53:35 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] Creating volume 97fb2ae2-c221-43e8-bb4b-475520315e75 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:53:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:35 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:53:35 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:53:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:35 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:53:35 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:53:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-97fb2ae2-c221-43e8-bb4b-475520315e75 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:35 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0eac117-ff50-4da7-a36c-6645088bbc50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:35 devstack sudo[87996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-97fb2ae2-c221-43e8-bb4b-475520315e75 1073741824 Apr 25 15:53:35 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:35 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64dabe5b-69de-4413-8cbd-834187ef9aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:35 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3ed93f3d-73d7-441c-86ce-3a43d70b80da tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-quobyte-72f9594b-eec1-4ab0-9278-ecc719b3ff06" acquired by "delete_volume" :: waited 0.061s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:53:35 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] Volume volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb (9d4e4385-e58d-473e-9cb0-934bc7b9b4eb): created successfully Apr 25 15:53:35 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64dabe5b-69de-4413-8cbd-834187ef9aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:35 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] Flow 'volume_create_manager' (16dcb057-511d-4667-b60f-500e4fccd965) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:53:35 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e0ee6f-ccff-4b30-aef4-f3e5011daa99]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:53:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3ed93f3d-73d7-441c-86ce-3a43d70b80da tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72f9594b-eec1-4ab0-9278-ecc719b3ff06 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:35 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-4380708f-6487-4212-8a90-d5182b763b8d tempest-CinderUnicodeTest-1487377300 None] Created volume successfully. Apr 25 15:53:35 devstack sudo[87998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72f9594b-eec1-4ab0-9278-ecc719b3ff06 Apr 25 15:53:35 devstack sudo[87998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:36 devstack sudo[87998]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3ed93f3d-73d7-441c-86ce-3a43d70b80da tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72f9594b-eec1-4ab0-9278-ecc719b3ff06" returned: 0 in 0.552s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3ed93f3d-73d7-441c-86ce-3a43d70b80da tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72f9594b-eec1-4ab0-9278-ecc719b3ff06 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:36 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-97fb2ae2-c221-43e8-bb4b-475520315e75 1073741824" returned: 0 in 0.641s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:36 devstack sudo[88006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72f9594b-eec1-4ab0-9278-ecc719b3ff06 Apr 25 15:53:36 devstack sudo[88006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-97fb2ae2-c221-43e8-bb4b-475520315e75 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:36 devstack sudo[88008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-97fb2ae2-c221-43e8-bb4b-475520315e75 Apr 25 15:53:36 devstack sudo[88008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0f6b91d0-a7fc-4a92-8157-a3a5ae9b20ae tempest-CinderUnicodeTest-1487377300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:36 devstack sudo[88006]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3ed93f3d-73d7-441c-86ce-3a43d70b80da tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-72f9594b-eec1-4ab0-9278-ecc719b3ff06" returned: 0 in 0.538s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:36 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3ed93f3d-73d7-441c-86ce-3a43d70b80da tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-quobyte-72f9594b-eec1-4ab0-9278-ecc719b3ff06" released by "delete_volume" :: held 1.133s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:53:36 devstack sudo[88008]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-97fb2ae2-c221-43e8-bb4b-475520315e75" returned: 0 in 0.536s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:36 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] <== create_volume: return (1218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:53:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0f6b91d0-a7fc-4a92-8157-a3a5ae9b20ae tempest-CinderUnicodeTest-1487377300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.122s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:36 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-3ed93f3d-73d7-441c-86ce-3a43d70b80da tempest-VolumesSnapshotTestJSON-1680973878 None] Created reservations ['9706eebf-24d4-4f74-9e19-f796ebc0062e', 'd203f82f-b1fc-4e2a-90ff-2231db9bf877', '3bc7b708-d174-4e2c-885d-5ccaa5e60424', '32d02aa1-cdb9-4e08-8288-2262f8e75c45'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:53:36 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9dcf370-82f1-4434-bada-aba123a5bbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97fb2ae2-c221-43e8-bb4b-475520315e75', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:36 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45679566-cedb-41ee-abd4-ad4cb122a953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:37 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-0f6b91d0-a7fc-4a92-8157-a3a5ae9b20ae tempest-CinderUnicodeTest-1487377300 None] Creating offline snapshot 34e4cd13-11a9-47df-8f36-51b3458d4a4b of volume 9d4e4385-e58d-473e-9cb0-934bc7b9b4eb {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 15:53:37 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] Volume volume-97fb2ae2-c221-43e8-bb4b-475520315e75 (97fb2ae2-c221-43e8-bb4b-475520315e75): created successfully Apr 25 15:53:37 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45679566-cedb-41ee-abd4-ad4cb122a953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:37 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] Flow 'volume_create_manager' (ef77eaef-a953-4605-bbab-6ba1639abfd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:53:37 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2ea645-029e-4d6c-885b-97485c0a091c]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:53:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0f6b91d0-a7fc-4a92-8157-a3a5ae9b20ae tempest-CinderUnicodeTest-1487377300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:37 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-9daa817f-a356-4d7c-babf-67c15ef7c95f tempest-GroupsTest-637970300 None] Created volume successfully. Apr 25 15:53:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3ed93f3d-73d7-441c-86ce-3a43d70b80da tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3ed93f3d-73d7-441c-86ce-3a43d70b80da tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:37 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3ed93f3d-73d7-441c-86ce-3a43d70b80da tempest-VolumesSnapshotTestJSON-1680973878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:53:37 devstack sudo[88013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb Apr 25 15:53:37 devstack sudo[88013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:37 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3ed93f3d-73d7-441c-86ce-3a43d70b80da tempest-VolumesSnapshotTestJSON-1680973878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:53:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3ed93f3d-73d7-441c-86ce-3a43d70b80da tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3ed93f3d-73d7-441c-86ce-3a43d70b80da tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:37 devstack sudo[88015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:53:37 devstack sudo[88015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:37 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:53:37 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] Flow 'volume_create_manager' (3f5352e1-0d9b-4761-a733-e860c3a9428a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:53:37 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d16891a8-d69b-4554-8f12-8192e28f6352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:37 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d16891a8-d69b-4554-8f12-8192e28f6352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2119685499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=faed51e2-4cf0-41d2-a095-1ba00877c9e8,host='devstack@QuobyteHD#QuobyteHD',id=66614684-fe90-4d9c-b792-6eb8f0e0015f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed1133e7868a400ea606550625b00db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:53:38Z,use_quota=True,user_id='f972deb3b56b4cf181d0168753c64304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4087d5-7c60-4b19-8165-12fda46a1b51),volume_type_id=0d4087d5-7c60-4b19-8165-12fda46a1b51)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:37 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8edb6a62-aad8-4f4a-9849-dae3d571ca56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:37 devstack sudo[88015]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:37 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8edb6a62-aad8-4f4a-9849-dae3d571ca56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:37 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d792fedf-26f2-4167-9fd5-8fda48518323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:37 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d792fedf-26f2-4167-9fd5-8fda48518323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66614684-fe90-4d9c-b792-6eb8f0e0015f', 'volume_name': 'volume-66614684-fe90-4d9c-b792-6eb8f0e0015f', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:37 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a4b6ca-fd1a-44fa-8dc9-ee99d9cc7063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:37 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17a4b6ca-fd1a-44fa-8dc9-ee99d9cc7063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:37 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e135aa1-4f45-464a-82a8-9647b7f38a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:37 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] Volume 66614684-fe90-4d9c-b792-6eb8f0e0015f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66614684-fe90-4d9c-b792-6eb8f0e0015f', 'volume_size': 1} Apr 25 15:53:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3ed93f3d-73d7-441c-86ce-3a43d70b80da tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.517s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:37 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-3ed93f3d-73d7-441c-86ce-3a43d70b80da tempest-VolumesSnapshotTestJSON-1680973878 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:53:37 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-3ed93f3d-73d7-441c-86ce-3a43d70b80da tempest-VolumesSnapshotTestJSON-1680973878 None] Deleted volume successfully. Apr 25 15:53:37 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3ed93f3d-73d7-441c-86ce-3a43d70b80da tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-72f9594b-eec1-4ab0-9278-ecc719b3ff06-delete_volume" released by "delete_volume" :: held 1.977s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:53:37 devstack sudo[88013]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0f6b91d0-a7fc-4a92-8157-a3a5ae9b20ae tempest-CinderUnicodeTest-1487377300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb" returned: 0 in 0.654s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0f6b91d0-a7fc-4a92-8157-a3a5ae9b20ae tempest-CinderUnicodeTest-1487377300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb.34e4cd13-11a9-47df-8f36-51b3458d4a4b 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:37 devstack sudo[88021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb.34e4cd13-11a9-47df-8f36-51b3458d4a4b 1G Apr 25 15:53:37 devstack sudo[88021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:37 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-90be0e3d-991f-4771-b174-898f98942c53 tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "cinder-1784751a-2776-4f15-b85a-aae6445af1da-delete_snapshot" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:53:38 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-90be0e3d-991f-4771-b174-898f98942c53 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-1784751a-2776-4f15-b85a-aae6445af1da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:53:38 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-90be0e3d-991f-4771-b174-898f98942c53 tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "cinder-quobyte-ff0ec0d6-6438-46fc-8c47-05d6494a6953" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:53:38 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-90be0e3d-991f-4771-b174-898f98942c53 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-quobyte-ff0ec0d6-6438-46fc-8c47-05d6494a6953" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:53:38 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-90be0e3d-991f-4771-b174-898f98942c53 tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "cinder-quobyte-1784751a-2776-4f15-b85a-aae6445af1da" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:53:38 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-90be0e3d-991f-4771-b174-898f98942c53 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-quobyte-1784751a-2776-4f15-b85a-aae6445af1da" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:53:38 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-90be0e3d-991f-4771-b174-898f98942c53 tempest-VolumesSnapshotTestJSON-1680973878 None] Deleting offline snapshot 1784751a-2776-4f15-b85a-aae6445af1da of volume ff0ec0d6-6438-46fc-8c47-05d6494a6953 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 15:53:38 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-90be0e3d-991f-4771-b174-898f98942c53 tempest-VolumesSnapshotTestJSON-1680973878 None] snapshot_file for this snap is: volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953.1784751a-2776-4f15-b85a-aae6445af1da {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 15:53:38 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbea969-2ead-4012-9498-a0b734d160fa]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:53:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-90be0e3d-991f-4771-b174-898f98942c53 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953.1784751a-2776-4f15-b85a-aae6445af1da {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:38 devstack sudo[88023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953.1784751a-2776-4f15-b85a-aae6445af1da Apr 25 15:53:38 devstack sudo[88023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:38 devstack sudo[88021]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0f6b91d0-a7fc-4a92-8157-a3a5ae9b20ae tempest-CinderUnicodeTest-1487377300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb.34e4cd13-11a9-47df-8f36-51b3458d4a4b 1G" returned: 0 in 0.612s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0f6b91d0-a7fc-4a92-8157-a3a5ae9b20ae tempest-CinderUnicodeTest-1487377300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb.34e4cd13-11a9-47df-8f36-51b3458d4a4b {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:38 devstack sudo[88028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb.34e4cd13-11a9-47df-8f36-51b3458d4a4b Apr 25 15:53:38 devstack sudo[88028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:38 devstack sudo[88023]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-90be0e3d-991f-4771-b174-898f98942c53 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953.1784751a-2776-4f15-b85a-aae6445af1da" returned: 0 in 0.548s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:38 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-90be0e3d-991f-4771-b174-898f98942c53 tempest-VolumesSnapshotTestJSON-1680973878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:53:38 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c604a2-878a-48e0-9046-1317247c0f29]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:53:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-90be0e3d-991f-4771-b174-898f98942c53 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:38 devstack sudo[88033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953 Apr 25 15:53:38 devstack sudo[88033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:38 devstack sudo[88028]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0f6b91d0-a7fc-4a92-8157-a3a5ae9b20ae tempest-CinderUnicodeTest-1487377300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb.34e4cd13-11a9-47df-8f36-51b3458d4a4b" returned: 0 in 0.489s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:38 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-0f6b91d0-a7fc-4a92-8157-a3a5ae9b20ae tempest-CinderUnicodeTest-1487377300 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb.34e4cd13-11a9-47df-8f36-51b3458d4a4b is being set with open permissions: ugo+rw Apr 25 15:53:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0f6b91d0-a7fc-4a92-8157-a3a5ae9b20ae tempest-CinderUnicodeTest-1487377300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb.34e4cd13-11a9-47df-8f36-51b3458d4a4b {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:38 devstack sudo[88038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb.34e4cd13-11a9-47df-8f36-51b3458d4a4b Apr 25 15:53:38 devstack sudo[88038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:39 devstack sudo[88033]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-90be0e3d-991f-4771-b174-898f98942c53 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953" returned: 0 in 0.501s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-90be0e3d-991f-4771-b174-898f98942c53 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953.1784751a-2776-4f15-b85a-aae6445af1da {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:39 devstack sudo[88043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953.1784751a-2776-4f15-b85a-aae6445af1da Apr 25 15:53:39 devstack sudo[88043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:39 devstack sudo[88038]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0f6b91d0-a7fc-4a92-8157-a3a5ae9b20ae tempest-CinderUnicodeTest-1487377300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb.34e4cd13-11a9-47df-8f36-51b3458d4a4b" returned: 0 in 0.471s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0f6b91d0-a7fc-4a92-8157-a3a5ae9b20ae tempest-CinderUnicodeTest-1487377300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:39 devstack sudo[88046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb.info Apr 25 15:53:39 devstack sudo[88046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:39 devstack sudo[88043]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-90be0e3d-991f-4771-b174-898f98942c53 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953.1784751a-2776-4f15-b85a-aae6445af1da" returned: 0 in 0.556s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-90be0e3d-991f-4771-b174-898f98942c53 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953.1784751a-2776-4f15-b85a-aae6445af1da {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:39 devstack sudo[88052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953.1784751a-2776-4f15-b85a-aae6445af1da Apr 25 15:53:39 devstack sudo[88052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:39 devstack sudo[88046]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0f6b91d0-a7fc-4a92-8157-a3a5ae9b20ae tempest-CinderUnicodeTest-1487377300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb.info" returned: 0 in 0.456s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:39 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-0f6b91d0-a7fc-4a92-8157-a3a5ae9b20ae tempest-CinderUnicodeTest-1487377300 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb.info is being set with open permissions: ugo+rw Apr 25 15:53:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0f6b91d0-a7fc-4a92-8157-a3a5ae9b20ae tempest-CinderUnicodeTest-1487377300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:39 devstack sudo[88054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb.info Apr 25 15:53:39 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:40 devstack sudo[88052]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:40 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-90be0e3d-991f-4771-b174-898f98942c53 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953.1784751a-2776-4f15-b85a-aae6445af1da" returned: 0 in 0.476s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0f6b91d0-a7fc-4a92-8157-a3a5ae9b20ae tempest-CinderUnicodeTest-1487377300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb.info" returned: 0 in 0.434s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0f6b91d0-a7fc-4a92-8157-a3a5ae9b20ae tempest-CinderUnicodeTest-1487377300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.233s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.571s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=faed51e2-4cf0-41d2-a095-1ba00877c9e8,created_at=2026-04-25T13:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2119685499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=faed51e2-4cf0-41d2-a095-1ba00877c9e8,host='devstack@QuobyteHD#QuobyteHD',id=66614684-fe90-4d9c-b792-6eb8f0e0015f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed1133e7868a400ea606550625b00db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:53:38Z,use_quota=True,user_id='f972deb3b56b4cf181d0168753c64304',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d4087d5-7c60-4b19-8165-12fda46a1b51),volume_type_id=0d4087d5-7c60-4b19-8165-12fda46a1b51)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:53:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] Creating volume 66614684-fe90-4d9c-b792-6eb8f0e0015f {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:53:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:53:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:53:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:53:40 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:53:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-66614684-fe90-4d9c-b792-6eb8f0e0015f 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:40 devstack sudo[88059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-66614684-fe90-4d9c-b792-6eb8f0e0015f 1073741824 Apr 25 15:53:40 devstack sudo[88059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:40 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-0f6b91d0-a7fc-4a92-8157-a3a5ae9b20ae tempest-CinderUnicodeTest-1487377300 None] Create snapshot completed successfully Apr 25 15:53:40 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-90be0e3d-991f-4771-b174-898f98942c53 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-quobyte-1784751a-2776-4f15-b85a-aae6445af1da" released by "_delete_snapshot" :: held 2.255s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:53:40 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-90be0e3d-991f-4771-b174-898f98942c53 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-quobyte-ff0ec0d6-6438-46fc-8c47-05d6494a6953" released by "delete_snapshot" :: held 2.280s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:53:40 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-90be0e3d-991f-4771-b174-898f98942c53 tempest-VolumesSnapshotTestJSON-1680973878 None] Created reservations ['43b39b89-c434-46f6-b168-1d53ebed93e4', '284504fa-aac6-4cf5-bb3d-96a5cd6c1314', 'c58e295f-00ce-4ecf-8cfd-b1f1b74abefa', '09db26bf-bd21-48b4-9f38-e5c2dbe001af'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:53:40 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-90be0e3d-991f-4771-b174-898f98942c53 tempest-VolumesSnapshotTestJSON-1680973878 None] Delete snapshot completed successfully. Apr 25 15:53:40 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-90be0e3d-991f-4771-b174-898f98942c53 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-1784751a-2776-4f15-b85a-aae6445af1da-delete_snapshot" released by "delete_snapshot" :: held 2.408s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:53:40 devstack sudo[88059]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-66614684-fe90-4d9c-b792-6eb8f0e0015f 1073741824" returned: 0 in 0.627s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-66614684-fe90-4d9c-b792-6eb8f0e0015f {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:40 devstack sudo[88064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-66614684-fe90-4d9c-b792-6eb8f0e0015f Apr 25 15:53:40 devstack sudo[88064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:41 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-15ff11a7-e2f4-4512-af07-90513a490983 tempest-CinderUnicodeTest-1487377300 None] Acquiring lock "cinder-34e4cd13-11a9-47df-8f36-51b3458d4a4b-delete_snapshot" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:53:41 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-15ff11a7-e2f4-4512-af07-90513a490983 tempest-CinderUnicodeTest-1487377300 None] Lock "cinder-34e4cd13-11a9-47df-8f36-51b3458d4a4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:53:41 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-15ff11a7-e2f4-4512-af07-90513a490983 tempest-CinderUnicodeTest-1487377300 None] Acquiring lock "cinder-quobyte-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:53:41 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-15ff11a7-e2f4-4512-af07-90513a490983 tempest-CinderUnicodeTest-1487377300 None] Lock "cinder-quobyte-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:53:41 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-15ff11a7-e2f4-4512-af07-90513a490983 tempest-CinderUnicodeTest-1487377300 None] Acquiring lock "cinder-quobyte-34e4cd13-11a9-47df-8f36-51b3458d4a4b" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:53:41 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-15ff11a7-e2f4-4512-af07-90513a490983 tempest-CinderUnicodeTest-1487377300 None] Lock "cinder-quobyte-34e4cd13-11a9-47df-8f36-51b3458d4a4b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:53:41 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-15ff11a7-e2f4-4512-af07-90513a490983 tempest-CinderUnicodeTest-1487377300 None] Deleting offline snapshot 34e4cd13-11a9-47df-8f36-51b3458d4a4b of volume 9d4e4385-e58d-473e-9cb0-934bc7b9b4eb {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 15:53:41 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-15ff11a7-e2f4-4512-af07-90513a490983 tempest-CinderUnicodeTest-1487377300 None] snapshot_file for this snap is: volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb.34e4cd13-11a9-47df-8f36-51b3458d4a4b {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 15:53:41 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[85099273-b240-4845-bbea-bc0d0e62639b]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:53:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-15ff11a7-e2f4-4512-af07-90513a490983 tempest-CinderUnicodeTest-1487377300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb.34e4cd13-11a9-47df-8f36-51b3458d4a4b {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:41 devstack sudo[88066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb.34e4cd13-11a9-47df-8f36-51b3458d4a4b Apr 25 15:53:41 devstack sudo[88066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:41 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-67aaf6e3-9ac1-4043-8f75-e27f4fab55e9 tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "cinder-ff0ec0d6-6438-46fc-8c47-05d6494a6953-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:53:41 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-67aaf6e3-9ac1-4043-8f75-e27f4fab55e9 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-ff0ec0d6-6438-46fc-8c47-05d6494a6953-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:53:41 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-67aaf6e3-9ac1-4043-8f75-e27f4fab55e9 tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "cinder-quobyte-ff0ec0d6-6438-46fc-8c47-05d6494a6953" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:53:41 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-67aaf6e3-9ac1-4043-8f75-e27f4fab55e9 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-quobyte-ff0ec0d6-6438-46fc-8c47-05d6494a6953" acquired by "delete_volume" :: waited 0.014s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:53:41 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf530041-98eb-46bc-af34-548cd55e9a88]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:53:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-67aaf6e3-9ac1-4043-8f75-e27f4fab55e9 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:41 devstack sudo[88064]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-66614684-fe90-4d9c-b792-6eb8f0e0015f" returned: 0 in 0.490s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:41 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:53:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:41 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e135aa1-4f45-464a-82a8-9647b7f38a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66614684-fe90-4d9c-b792-6eb8f0e0015f', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:41 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd847d4a-567f-44fe-a426-3aebbca11741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:41 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] Volume volume-66614684-fe90-4d9c-b792-6eb8f0e0015f (66614684-fe90-4d9c-b792-6eb8f0e0015f): created successfully Apr 25 15:53:41 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd847d4a-567f-44fe-a426-3aebbca11741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:41 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] Flow 'volume_create_manager' (3f5352e1-0d9b-4761-a733-e860c3a9428a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:53:41 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-1860af82-8492-45bd-89b2-569bc832bd6a tempest-GroupsTest-637970300 None] Created volume successfully. Apr 25 15:53:41 devstack sudo[88070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953 Apr 25 15:53:41 devstack sudo[88070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:41 devstack sudo[88066]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-15ff11a7-e2f4-4512-af07-90513a490983 tempest-CinderUnicodeTest-1487377300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb.34e4cd13-11a9-47df-8f36-51b3458d4a4b" returned: 0 in 0.576s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:41 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-15ff11a7-e2f4-4512-af07-90513a490983 tempest-CinderUnicodeTest-1487377300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:53:41 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f64e64f-f395-4a5d-a8c8-6b1506c3f171]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:53:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-15ff11a7-e2f4-4512-af07-90513a490983 tempest-CinderUnicodeTest-1487377300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:41 devstack sudo[88075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb Apr 25 15:53:41 devstack sudo[88075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:41 devstack sudo[88070]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-67aaf6e3-9ac1-4043-8f75-e27f4fab55e9 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953" returned: 0 in 0.546s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-67aaf6e3-9ac1-4043-8f75-e27f4fab55e9 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:41 devstack sudo[88080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953 Apr 25 15:53:41 devstack sudo[88080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:42 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-1fbfb119-c4c1-499b-8b04-5be030614ea0 tempest-GroupsTest-637970300 None] Update group completed successfully. Apr 25 15:53:42 devstack sudo[88075]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-15ff11a7-e2f4-4512-af07-90513a490983 tempest-CinderUnicodeTest-1487377300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb" returned: 0 in 0.553s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-15ff11a7-e2f4-4512-af07-90513a490983 tempest-CinderUnicodeTest-1487377300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb.34e4cd13-11a9-47df-8f36-51b3458d4a4b {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:42 devstack sudo[88086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb.34e4cd13-11a9-47df-8f36-51b3458d4a4b Apr 25 15:53:42 devstack sudo[88086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:42 devstack sudo[88080]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-67aaf6e3-9ac1-4043-8f75-e27f4fab55e9 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ff0ec0d6-6438-46fc-8c47-05d6494a6953" returned: 0 in 0.475s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:42 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-67aaf6e3-9ac1-4043-8f75-e27f4fab55e9 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-quobyte-ff0ec0d6-6438-46fc-8c47-05d6494a6953" released by "delete_volume" :: held 1.077s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:53:42 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-67aaf6e3-9ac1-4043-8f75-e27f4fab55e9 tempest-VolumesSnapshotTestJSON-1680973878 None] Created reservations ['748e74f6-d631-4f6a-b7de-3e643084eb33', '03ae614e-13c0-491a-8045-88726988644a', 'a2d5060b-2365-4648-b483-be89ba297cb7', '6b4f4da0-dc11-4db2-93a5-82fcf0e5bfb5'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:53:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-67aaf6e3-9ac1-4043-8f75-e27f4fab55e9 tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-67aaf6e3-9ac1-4043-8f75-e27f4fab55e9 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:42 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-67aaf6e3-9ac1-4043-8f75-e27f4fab55e9 tempest-VolumesSnapshotTestJSON-1680973878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:53:42 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-67aaf6e3-9ac1-4043-8f75-e27f4fab55e9 tempest-VolumesSnapshotTestJSON-1680973878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:53:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-67aaf6e3-9ac1-4043-8f75-e27f4fab55e9 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-67aaf6e3-9ac1-4043-8f75-e27f4fab55e9 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:42 devstack sudo[88088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:53:42 devstack sudo[88088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:42 devstack sudo[88086]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-15ff11a7-e2f4-4512-af07-90513a490983 tempest-CinderUnicodeTest-1487377300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb.34e4cd13-11a9-47df-8f36-51b3458d4a4b" returned: 0 in 0.529s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-15ff11a7-e2f4-4512-af07-90513a490983 tempest-CinderUnicodeTest-1487377300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb.34e4cd13-11a9-47df-8f36-51b3458d4a4b {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:42 devstack sudo[88093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb.34e4cd13-11a9-47df-8f36-51b3458d4a4b Apr 25 15:53:42 devstack sudo[88093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:42 devstack sudo[88088]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-67aaf6e3-9ac1-4043-8f75-e27f4fab55e9 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.454s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:42 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-67aaf6e3-9ac1-4043-8f75-e27f4fab55e9 tempest-VolumesSnapshotTestJSON-1680973878 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:53:42 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-67aaf6e3-9ac1-4043-8f75-e27f4fab55e9 tempest-VolumesSnapshotTestJSON-1680973878 None] Deleted volume successfully. Apr 25 15:53:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-67aaf6e3-9ac1-4043-8f75-e27f4fab55e9 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-ff0ec0d6-6438-46fc-8c47-05d6494a6953-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:53:43 devstack sudo[88093]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-15ff11a7-e2f4-4512-af07-90513a490983 tempest-CinderUnicodeTest-1487377300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb.34e4cd13-11a9-47df-8f36-51b3458d4a4b" returned: 0 in 0.442s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-15ff11a7-e2f4-4512-af07-90513a490983 tempest-CinderUnicodeTest-1487377300 None] Lock "cinder-quobyte-34e4cd13-11a9-47df-8f36-51b3458d4a4b" released by "_delete_snapshot" :: held 2.203s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:53:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-15ff11a7-e2f4-4512-af07-90513a490983 tempest-CinderUnicodeTest-1487377300 None] Lock "cinder-quobyte-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb" released by "delete_snapshot" :: held 2.228s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:53:43 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-15ff11a7-e2f4-4512-af07-90513a490983 tempest-CinderUnicodeTest-1487377300 None] Created reservations ['573093ad-aef1-4c96-8b67-6ecc8133be92', 'e0267fad-3aa0-41c5-8679-507c6f0b6453', 'ff66a6d0-94ba-474a-97d4-aaea0413cdff', '957fae65-924c-4298-bb19-9878ceb44803'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:53:43 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-15ff11a7-e2f4-4512-af07-90513a490983 tempest-CinderUnicodeTest-1487377300 None] Delete snapshot completed successfully. Apr 25 15:53:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-15ff11a7-e2f4-4512-af07-90513a490983 tempest-CinderUnicodeTest-1487377300 None] Lock "cinder-34e4cd13-11a9-47df-8f36-51b3458d4a4b-delete_snapshot" released by "delete_snapshot" :: held 2.378s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:53:43 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-26276ebf-428f-4355-baea-21cc99c39a02 tempest-GroupsTest-637970300 None] Update group completed successfully. Apr 25 15:53:43 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:53:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] Flow 'volume_create_manager' (ddfa0e54-aa11-4bf0-807f-68fc91715e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:53:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1c9718-06d0-4ddd-a344-a998e7113c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1c9718-06d0-4ddd-a344-a998e7113c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-575196880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26a1a73f-c398-441d-b8a0-825b0a9001d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4db9c91c22c146dc83a399cfea0a4c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:53:44Z,use_quota=True,user_id='90f6adadb99a4c8485b48ebbc5672c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b75166bf-cf89-45cc-9ffb-9e17a306b176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b75166bf-cf89-45cc-9ffb-9e17a306b176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc00b0fc-780d-459e-9943-ee6d9d613611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc00b0fc-780d-459e-9943-ee6d9d613611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26a1a73f-c398-441d-b8a0-825b0a9001d3', 'volume_name': 'volume-26a1a73f-c398-441d-b8a0-825b0a9001d3', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17473852-f187-4e87-ae70-756c29cfc2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17473852-f187-4e87-ae70-756c29cfc2a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a82c713-635b-494a-bfcd-41b3659b8b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:43 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] Volume 26a1a73f-c398-441d-b8a0-825b0a9001d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26a1a73f-c398-441d-b8a0-825b0a9001d3', 'volume_size': 1} Apr 25 15:53:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:43 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:53:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-575196880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26a1a73f-c398-441d-b8a0-825b0a9001d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4db9c91c22c146dc83a399cfea0a4c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:53:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:53:44Z,use_quota=True,user_id='90f6adadb99a4c8485b48ebbc5672c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:53:43 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] Creating volume 26a1a73f-c398-441d-b8a0-825b0a9001d3 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:53:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:43 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:53:43 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:53:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:43 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:53:43 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:53:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:43 devstack sudo[88099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3 1073741824 Apr 25 15:53:43 devstack sudo[88099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:44 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-23c10060-497e-4a5e-aee0-b8975111472e tempest-CinderUnicodeTest-1487377300 None] Acquiring lock "cinder-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:53:44 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-23c10060-497e-4a5e-aee0-b8975111472e tempest-CinderUnicodeTest-1487377300 None] Lock "cinder-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:53:44 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-23c10060-497e-4a5e-aee0-b8975111472e tempest-CinderUnicodeTest-1487377300 None] Acquiring lock "cinder-quobyte-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:53:44 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-23c10060-497e-4a5e-aee0-b8975111472e tempest-CinderUnicodeTest-1487377300 None] Lock "cinder-quobyte-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb" acquired by "delete_volume" :: waited 0.017s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:53:44 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0643fe-9262-460d-84b9-2c980c04d46d]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:53:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-23c10060-497e-4a5e-aee0-b8975111472e tempest-CinderUnicodeTest-1487377300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:44 devstack sudo[88104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb Apr 25 15:53:44 devstack sudo[88104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:44 devstack sudo[88099]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3 1073741824" returned: 0 in 0.611s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:44 devstack sudo[88106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3 Apr 25 15:53:44 devstack sudo[88106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:44 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9b0bdcde-1bc2-4d24-80e3-4e6cd52fcb29 tempest-GroupsTest-637970300 None] Acquiring lock "cinder-quobyte-66614684-fe90-4d9c-b792-6eb8f0e0015f" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:53:45 devstack sudo[88104]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-23c10060-497e-4a5e-aee0-b8975111472e tempest-CinderUnicodeTest-1487377300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb" returned: 0 in 0.654s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-23c10060-497e-4a5e-aee0-b8975111472e tempest-CinderUnicodeTest-1487377300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:45 devstack sudo[88112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb Apr 25 15:53:45 devstack sudo[88112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:45 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9b0bdcde-1bc2-4d24-80e3-4e6cd52fcb29 tempest-GroupsTest-637970300 None] Lock "cinder-quobyte-66614684-fe90-4d9c-b792-6eb8f0e0015f" acquired by "delete_volume" :: waited 0.050s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:53:45 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[b150d7a1-6d13-4085-9d03-173b63fc1f79]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:53:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9b0bdcde-1bc2-4d24-80e3-4e6cd52fcb29 tempest-GroupsTest-637970300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-66614684-fe90-4d9c-b792-6eb8f0e0015f {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:45 devstack sudo[88106]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3" returned: 0 in 0.481s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:45 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:53:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a82c713-635b-494a-bfcd-41b3659b8b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26a1a73f-c398-441d-b8a0-825b0a9001d3', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6145fe8-3dd1-4d44-bfe5-48c394c0493e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:45 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] Volume volume-26a1a73f-c398-441d-b8a0-825b0a9001d3 (26a1a73f-c398-441d-b8a0-825b0a9001d3): created successfully Apr 25 15:53:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6145fe8-3dd1-4d44-bfe5-48c394c0493e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] Flow 'volume_create_manager' (ddfa0e54-aa11-4bf0-807f-68fc91715e56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:53:45 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-c14406de-89fb-46f6-8567-268db499c0ca tempest-VolumesSnapshotTestJSON-1680973878 None] Created volume successfully. Apr 25 15:53:45 devstack sudo[88114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-66614684-fe90-4d9c-b792-6eb8f0e0015f Apr 25 15:53:45 devstack sudo[88114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:45 devstack sudo[88112]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-23c10060-497e-4a5e-aee0-b8975111472e tempest-CinderUnicodeTest-1487377300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb" returned: 0 in 0.464s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:45 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-23c10060-497e-4a5e-aee0-b8975111472e tempest-CinderUnicodeTest-1487377300 None] Lock "cinder-quobyte-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb" released by "delete_volume" :: held 1.173s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:53:45 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-23c10060-497e-4a5e-aee0-b8975111472e tempest-CinderUnicodeTest-1487377300 None] Created reservations ['2ada5206-86f9-4cfc-9920-be29f1b5a173', '8bae5bde-09f8-4840-b600-565992906023', 'd6525d7c-09da-4c80-b859-e5cd67421d6e', '770e4520-3acd-46a2-80ae-c5a6628a1fa2'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:53:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-23c10060-497e-4a5e-aee0-b8975111472e tempest-CinderUnicodeTest-1487377300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-23c10060-497e-4a5e-aee0-b8975111472e tempest-CinderUnicodeTest-1487377300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:45 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-23c10060-497e-4a5e-aee0-b8975111472e tempest-CinderUnicodeTest-1487377300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:53:45 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-23c10060-497e-4a5e-aee0-b8975111472e tempest-CinderUnicodeTest-1487377300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:53:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-23c10060-497e-4a5e-aee0-b8975111472e tempest-CinderUnicodeTest-1487377300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-23c10060-497e-4a5e-aee0-b8975111472e tempest-CinderUnicodeTest-1487377300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:45 devstack sudo[88120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:53:45 devstack sudo[88120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:45 devstack sudo[88114]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9b0bdcde-1bc2-4d24-80e3-4e6cd52fcb29 tempest-GroupsTest-637970300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-66614684-fe90-4d9c-b792-6eb8f0e0015f" returned: 0 in 0.577s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9b0bdcde-1bc2-4d24-80e3-4e6cd52fcb29 tempest-GroupsTest-637970300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-66614684-fe90-4d9c-b792-6eb8f0e0015f {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:45 devstack sudo[88122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-66614684-fe90-4d9c-b792-6eb8f0e0015f Apr 25 15:53:45 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:46 devstack sudo[88120]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-23c10060-497e-4a5e-aee0-b8975111472e tempest-CinderUnicodeTest-1487377300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.448s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:46 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-23c10060-497e-4a5e-aee0-b8975111472e tempest-CinderUnicodeTest-1487377300 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:53:46 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-23c10060-497e-4a5e-aee0-b8975111472e tempest-CinderUnicodeTest-1487377300 None] Deleted volume successfully. Apr 25 15:53:46 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-23c10060-497e-4a5e-aee0-b8975111472e tempest-CinderUnicodeTest-1487377300 None] Lock "cinder-9d4e4385-e58d-473e-9cb0-934bc7b9b4eb-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:53:46 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9b0bdcde-1bc2-4d24-80e3-4e6cd52fcb29 tempest-GroupsTest-637970300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-66614684-fe90-4d9c-b792-6eb8f0e0015f" returned: 0 in 0.474s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:46 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9b0bdcde-1bc2-4d24-80e3-4e6cd52fcb29 tempest-GroupsTest-637970300 None] Lock "cinder-quobyte-66614684-fe90-4d9c-b792-6eb8f0e0015f" released by "delete_volume" :: held 1.096s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:53:46 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9b0bdcde-1bc2-4d24-80e3-4e6cd52fcb29 tempest-GroupsTest-637970300 None] Acquiring lock "cinder-quobyte-97fb2ae2-c221-43e8-bb4b-475520315e75" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:53:46 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9b0bdcde-1bc2-4d24-80e3-4e6cd52fcb29 tempest-GroupsTest-637970300 None] Lock "cinder-quobyte-97fb2ae2-c221-43e8-bb4b-475520315e75" acquired by "delete_volume" :: waited 0.034s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:53:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-dd6eceaa-aa71-4c7d-aa23-575093c921f4 tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-dd6eceaa-aa71-4c7d-aa23-575093c921f4 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:46 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ddc8c0-ffe6-4875-bb0c-72299be26642]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:53:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9b0bdcde-1bc2-4d24-80e3-4e6cd52fcb29 tempest-GroupsTest-637970300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-97fb2ae2-c221-43e8-bb4b-475520315e75 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:46 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-dd6eceaa-aa71-4c7d-aa23-575093c921f4 tempest-VolumesSnapshotTestJSON-1680973878 None] Creating offline snapshot 258edeca-8b66-427f-b874-f696e4acaf87 of volume 26a1a73f-c398-441d-b8a0-825b0a9001d3 {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 15:53:46 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[5843a2b9-53bd-46ce-89c6-99005ed5b790]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:53:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-dd6eceaa-aa71-4c7d-aa23-575093c921f4 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:46 devstack sudo[88126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-97fb2ae2-c221-43e8-bb4b-475520315e75 Apr 25 15:53:46 devstack sudo[88126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:46 devstack sudo[88127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3 Apr 25 15:53:46 devstack sudo[88127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:46 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d59bdcfa-407c-4995-b588-314801178c7c tempest-CinderUnicodeTest-1487377300 None] Acquiring lock "cinder-c287da82-7fb7-4b5e-a720-fdef95fd666b-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:53:46 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d59bdcfa-407c-4995-b588-314801178c7c tempest-CinderUnicodeTest-1487377300 None] Lock "cinder-c287da82-7fb7-4b5e-a720-fdef95fd666b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:53:46 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d59bdcfa-407c-4995-b588-314801178c7c tempest-CinderUnicodeTest-1487377300 None] Acquiring lock "cinder-quobyte-c287da82-7fb7-4b5e-a720-fdef95fd666b" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:53:46 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d59bdcfa-407c-4995-b588-314801178c7c tempest-CinderUnicodeTest-1487377300 None] Lock "cinder-quobyte-c287da82-7fb7-4b5e-a720-fdef95fd666b" acquired by "delete_volume" :: waited 0.028s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:53:46 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e64bae-c347-4144-b20b-b6a98054da1f]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:53:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d59bdcfa-407c-4995-b588-314801178c7c tempest-CinderUnicodeTest-1487377300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c287da82-7fb7-4b5e-a720-fdef95fd666b {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:46 devstack sudo[88130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c287da82-7fb7-4b5e-a720-fdef95fd666b Apr 25 15:53:46 devstack sudo[88130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:46 devstack sudo[88126]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9b0bdcde-1bc2-4d24-80e3-4e6cd52fcb29 tempest-GroupsTest-637970300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-97fb2ae2-c221-43e8-bb4b-475520315e75" returned: 0 in 0.560s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9b0bdcde-1bc2-4d24-80e3-4e6cd52fcb29 tempest-GroupsTest-637970300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-97fb2ae2-c221-43e8-bb4b-475520315e75 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:46 devstack sudo[88138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-97fb2ae2-c221-43e8-bb4b-475520315e75 Apr 25 15:53:46 devstack sudo[88138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:46 devstack sudo[88127]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-dd6eceaa-aa71-4c7d-aa23-575093c921f4 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3" returned: 0 in 0.560s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-dd6eceaa-aa71-4c7d-aa23-575093c921f4 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3.258edeca-8b66-427f-b874-f696e4acaf87 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:46 devstack sudo[88140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3.258edeca-8b66-427f-b874-f696e4acaf87 1G Apr 25 15:53:46 devstack sudo[88140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:47 devstack sudo[88130]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d59bdcfa-407c-4995-b588-314801178c7c tempest-CinderUnicodeTest-1487377300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c287da82-7fb7-4b5e-a720-fdef95fd666b" returned: 0 in 0.519s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d59bdcfa-407c-4995-b588-314801178c7c tempest-CinderUnicodeTest-1487377300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c287da82-7fb7-4b5e-a720-fdef95fd666b {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:47 devstack sudo[88146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c287da82-7fb7-4b5e-a720-fdef95fd666b Apr 25 15:53:47 devstack sudo[88146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:47 devstack sudo[88138]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9b0bdcde-1bc2-4d24-80e3-4e6cd52fcb29 tempest-GroupsTest-637970300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-97fb2ae2-c221-43e8-bb4b-475520315e75" returned: 0 in 0.494s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:47 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9b0bdcde-1bc2-4d24-80e3-4e6cd52fcb29 tempest-GroupsTest-637970300 None] Lock "cinder-quobyte-97fb2ae2-c221-43e8-bb4b-475520315e75" released by "delete_volume" :: held 1.101s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:53:47 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-9b0bdcde-1bc2-4d24-80e3-4e6cd52fcb29 tempest-GroupsTest-637970300 None] Created reservations ['37c4fc80-a1fc-45c7-bc9f-595578053327'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:53:47 devstack cinder-volume[81828]: WARNING cinder.quota [None req-9b0bdcde-1bc2-4d24-80e3-4e6cd52fcb29 tempest-GroupsTest-637970300 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-60311770 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-60311770, it is now deprecated. Please use the default quota class for default quota. Apr 25 15:53:47 devstack cinder-volume[81828]: WARNING cinder.quota [None req-9b0bdcde-1bc2-4d24-80e3-4e6cd52fcb29 tempest-GroupsTest-637970300 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-60311770 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-60311770, it is now deprecated. Please use the default quota class for default quota. Apr 25 15:53:47 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-9b0bdcde-1bc2-4d24-80e3-4e6cd52fcb29 tempest-GroupsTest-637970300 None] Created reservations ['87b08458-8b15-4300-a031-a1629cf1fb64', '20150734-a9b9-4cb4-95f0-b10e86c5f6d0', '3c72cf37-9e3b-4d0e-bb0b-ca1cca25d415', 'fa908806-b5bf-4b83-9066-bb69ae45e193'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:53:47 devstack sudo[88140]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-dd6eceaa-aa71-4c7d-aa23-575093c921f4 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3.258edeca-8b66-427f-b874-f696e4acaf87 1G" returned: 0 in 0.657s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-dd6eceaa-aa71-4c7d-aa23-575093c921f4 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26a1a73f-c398-441d-b8a0-825b0a9001d3 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3.258edeca-8b66-427f-b874-f696e4acaf87 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:47 devstack sudo[88151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26a1a73f-c398-441d-b8a0-825b0a9001d3 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3.258edeca-8b66-427f-b874-f696e4acaf87 Apr 25 15:53:47 devstack sudo[88151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:47 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-9b0bdcde-1bc2-4d24-80e3-4e6cd52fcb29 tempest-GroupsTest-637970300 None] Created reservations ['a14d9164-765d-48b2-877b-8fdc7988acac', '6d8a85bd-5f1f-41e1-88c0-3c2496bac8e9', '43df6d48-5a91-4de6-baeb-ae8d18864363', '3fcab604-34ad-4f14-add3-1d0dcc09c98d'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:53:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9b0bdcde-1bc2-4d24-80e3-4e6cd52fcb29 tempest-GroupsTest-637970300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9b0bdcde-1bc2-4d24-80e3-4e6cd52fcb29 tempest-GroupsTest-637970300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-9b0bdcde-1bc2-4d24-80e3-4e6cd52fcb29 tempest-GroupsTest-637970300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:53:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-9b0bdcde-1bc2-4d24-80e3-4e6cd52fcb29 tempest-GroupsTest-637970300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:53:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9b0bdcde-1bc2-4d24-80e3-4e6cd52fcb29 tempest-GroupsTest-637970300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9b0bdcde-1bc2-4d24-80e3-4e6cd52fcb29 tempest-GroupsTest-637970300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:47 devstack sudo[88146]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:47 devstack sudo[88154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:53:47 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d59bdcfa-407c-4995-b588-314801178c7c tempest-CinderUnicodeTest-1487377300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c287da82-7fb7-4b5e-a720-fdef95fd666b" returned: 0 in 0.545s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:47 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d59bdcfa-407c-4995-b588-314801178c7c tempest-CinderUnicodeTest-1487377300 None] Lock "cinder-quobyte-c287da82-7fb7-4b5e-a720-fdef95fd666b" released by "delete_volume" :: held 1.107s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:53:47 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-d59bdcfa-407c-4995-b588-314801178c7c tempest-CinderUnicodeTest-1487377300 None] Created reservations ['e193e635-bd7e-4abb-af7c-dab787690b60', '3bf02f12-02a1-45f1-9297-d8ba9712d98b', '47e50322-4804-439a-a7e1-1e4171c646ae', '27051900-2eea-4b0c-abbb-3bd133a89e21'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:53:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d59bdcfa-407c-4995-b588-314801178c7c tempest-CinderUnicodeTest-1487377300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d59bdcfa-407c-4995-b588-314801178c7c tempest-CinderUnicodeTest-1487377300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d59bdcfa-407c-4995-b588-314801178c7c tempest-CinderUnicodeTest-1487377300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:53:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d59bdcfa-407c-4995-b588-314801178c7c tempest-CinderUnicodeTest-1487377300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:53:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d59bdcfa-407c-4995-b588-314801178c7c tempest-CinderUnicodeTest-1487377300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d59bdcfa-407c-4995-b588-314801178c7c tempest-CinderUnicodeTest-1487377300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:47 devstack sudo[88156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:53:47 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:47 devstack sudo[88151]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-dd6eceaa-aa71-4c7d-aa23-575093c921f4 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26a1a73f-c398-441d-b8a0-825b0a9001d3 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3.258edeca-8b66-427f-b874-f696e4acaf87" returned: 0 in 0.520s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:47 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-dd6eceaa-aa71-4c7d-aa23-575093c921f4 tempest-VolumesSnapshotTestJSON-1680973878 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3.258edeca-8b66-427f-b874-f696e4acaf87 is being set with open permissions: ugo+rw Apr 25 15:53:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-dd6eceaa-aa71-4c7d-aa23-575093c921f4 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3.258edeca-8b66-427f-b874-f696e4acaf87 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:48 devstack sudo[88161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3.258edeca-8b66-427f-b874-f696e4acaf87 Apr 25 15:53:48 devstack sudo[88161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:48 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9b0bdcde-1bc2-4d24-80e3-4e6cd52fcb29 tempest-GroupsTest-637970300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.461s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:48 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-9b0bdcde-1bc2-4d24-80e3-4e6cd52fcb29 tempest-GroupsTest-637970300 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:53:48 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-9b0bdcde-1bc2-4d24-80e3-4e6cd52fcb29 tempest-GroupsTest-637970300 None] Delete group completed successfully. Apr 25 15:53:48 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d59bdcfa-407c-4995-b588-314801178c7c tempest-CinderUnicodeTest-1487377300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.463s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:48 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-d59bdcfa-407c-4995-b588-314801178c7c tempest-CinderUnicodeTest-1487377300 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:53:48 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-d59bdcfa-407c-4995-b588-314801178c7c tempest-CinderUnicodeTest-1487377300 None] Deleted volume successfully. Apr 25 15:53:48 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d59bdcfa-407c-4995-b588-314801178c7c tempest-CinderUnicodeTest-1487377300 None] Lock "cinder-c287da82-7fb7-4b5e-a720-fdef95fd666b-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:53:48 devstack sudo[88161]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-dd6eceaa-aa71-4c7d-aa23-575093c921f4 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3.258edeca-8b66-427f-b874-f696e4acaf87" returned: 0 in 0.459s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-dd6eceaa-aa71-4c7d-aa23-575093c921f4 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:48 devstack sudo[88166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3.info Apr 25 15:53:48 devstack sudo[88166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:48 devstack sudo[88166]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-dd6eceaa-aa71-4c7d-aa23-575093c921f4 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3.info" returned: 0 in 0.515s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:48 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-dd6eceaa-aa71-4c7d-aa23-575093c921f4 tempest-VolumesSnapshotTestJSON-1680973878 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3.info is being set with open permissions: ugo+rw Apr 25 15:53:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-dd6eceaa-aa71-4c7d-aa23-575093c921f4 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:49 devstack sudo[88169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3.info Apr 25 15:53:49 devstack sudo[88169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:49 devstack sudo[88169]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-dd6eceaa-aa71-4c7d-aa23-575093c921f4 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3.info" returned: 0 in 0.524s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-dd6eceaa-aa71-4c7d-aa23-575093c921f4 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.346s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:49 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-dd6eceaa-aa71-4c7d-aa23-575093c921f4 tempest-VolumesSnapshotTestJSON-1680973878 None] Create snapshot completed successfully Apr 25 15:53:50 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:53:50 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Flow 'volume_create_manager' (4f2d84f9-1fea-41c1-a9dd-1bdf87e4ac75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:53:50 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e4de59-3b2f-447c-abc1-15a87cee4bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:50 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3e4de59-3b2f-447c-abc1-15a87cee4bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-313046444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73897ef3-80e1-42d1-99fa-9dd812742d03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4db9c91c22c146dc83a399cfea0a4c78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:53:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=258edeca-8b66-427f-b874-f696e4acaf87,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:53:51Z,use_quota=True,user_id='90f6adadb99a4c8485b48ebbc5672c4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:50 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82dcb584-d543-4f33-8925-ed94ae9bbe6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:50 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82dcb584-d543-4f33-8925-ed94ae9bbe6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:50 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8148cce-b511-4117-bf14-1c1d713c9e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:50 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8148cce-b511-4117-bf14-1c1d713c9e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '73897ef3-80e1-42d1-99fa-9dd812742d03', 'volume_name': 'volume-73897ef3-80e1-42d1-99fa-9dd812742d03', 'volume_size': 1, 'snapshot_id': '258edeca-8b66-427f-b874-f696e4acaf87'}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:50 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d9a759a-7c1d-4196-a90d-c780f333a147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:50 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d9a759a-7c1d-4196-a90d-c780f333a147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:50 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce80889-798a-493e-9ed2-b753b7ee12e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:50 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Volume 73897ef3-80e1-42d1-99fa-9dd812742d03: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-73897ef3-80e1-42d1-99fa-9dd812742d03', 'volume_size': 1, 'snapshot_id': '258edeca-8b66-427f-b874-f696e4acaf87'} Apr 25 15:53:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:50 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "cinder-quobyte-258edeca-8b66-427f-b874-f696e4acaf87-73897ef3-80e1-42d1-99fa-9dd812742d03" by "_create_volume_from_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:53:50 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-quobyte-258edeca-8b66-427f-b874-f696e4acaf87-73897ef3-80e1-42d1-99fa-9dd812742d03" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:53:50 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Creating volume 73897ef3-80e1-42d1-99fa-9dd812742d03 from snapshot 258edeca-8b66-427f-b874-f696e4acaf87 {{(pid=81828) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 25 15:53:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:50 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:53:50 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:53:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:50 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:53:50 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "cinder-quobyte-73897ef3-80e1-42d1-99fa-9dd812742d03" by "_copy_volume_from_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:53:50 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-quobyte-73897ef3-80e1-42d1-99fa-9dd812742d03" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:53:50 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] snapshot: 258edeca-8b66-427f-b874-f696e4acaf87, volume: 73897ef3-80e1-42d1-99fa-9dd812742d03, {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 25 15:53:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:51 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:53:51 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:53:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:51 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[529d739c-19c6-40a5-b52e-0de0e596a8cb]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:53:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3.258edeca-8b66-427f-b874-f696e4acaf87 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:51 devstack sudo[88179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3.258edeca-8b66-427f-b874-f696e4acaf87 Apr 25 15:53:51 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:51 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3.258edeca-8b66-427f-b874-f696e4acaf87" returned: 0 in 0.552s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:51 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26a1a73f-c398-441d-b8a0-825b0a9001d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:53:51 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] will copy from snapshot at /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3 {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 25 15:53:51 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Creating direct copy from snapshot {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 25 15:53:51 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd9ab22-80a8-4d6e-827a-1f388ac0d226]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:53:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:51 devstack sudo[88185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3 Apr 25 15:53:51 devstack sudo[88185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:52 devstack sudo[88185]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3" returned: 0 in 0.569s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:52 devstack cinder-volume[81828]: DEBUG cinder.utils [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Path /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-73897ef3-80e1-42d1-99fa-9dd812742d03 not found in is_blk_device check {{(pid=81828) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 25 15:53:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-73897ef3-80e1-42d1-99fa-9dd812742d03 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:52 devstack sudo[88190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-73897ef3-80e1-42d1-99fa-9dd812742d03 Apr 25 15:53:52 devstack sudo[88190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:53 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-85180392-2db8-4a0f-91d5-fd6ed113da06 tempest-GroupsV314Test-1329876139 None] Group tempest-GroupsV314Test-Group-1708330774: creating Apr 25 15:53:53 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-85180392-2db8-4a0f-91d5-fd6ed113da06 tempest-GroupsV314Test-1329876139 None] Group tempest-GroupsV314Test-Group-1708330774: created successfully Apr 25 15:53:53 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-85180392-2db8-4a0f-91d5-fd6ed113da06 tempest-GroupsV314Test-1329876139 None] Create group completed successfully. Apr 25 15:53:55 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:53:55 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] Flow 'volume_create_manager' (963f3916-e0b5-4bbf-9888-429fe9a60c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:53:55 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d37dae48-bf86-4b85-9458-907b6072e840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:55 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d37dae48-bf86-4b85-9458-907b6072e840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1808660096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56359877-fea0-4fd6-84b2-018db392d2c0,host='devstack@QuobyteHD#QuobyteHD',id=819c9ba1-ea8a-4520-9c4d-1a1cb6492613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec41f47e843b441aaa6adf19a8b32b48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:53:55Z,use_quota=True,user_id='5edf31ca27064c4c9f8d66718d25ff45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a334802-cc7b-4ff1-8862-26a24ec9c216),volume_type_id=7a334802-cc7b-4ff1-8862-26a24ec9c216)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:55 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c58e4606-9fd0-4b56-af63-fa19d3f0c4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:55 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c58e4606-9fd0-4b56-af63-fa19d3f0c4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:55 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9810d11c-a620-42d1-8e6a-93a2e5cdf0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:55 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9810d11c-a620-42d1-8e6a-93a2e5cdf0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '819c9ba1-ea8a-4520-9c4d-1a1cb6492613', 'volume_name': 'volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:55 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a9bf9ac-854b-490f-bd09-f32df2143e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:55 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a9bf9ac-854b-490f-bd09-f32df2143e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:55 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ec7f51-384b-47ea-9e0b-10a907b2730f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:55 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] Volume 819c9ba1-ea8a-4520-9c4d-1a1cb6492613: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613', 'volume_size': 1} Apr 25 15:53:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:57 devstack sudo[88190]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-73897ef3-80e1-42d1-99fa-9dd812742d03" returned: 0 in 4.944s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:57 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73923cf-3a07-419b-afdd-7eb7fc4965ca]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:53:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:57 devstack sudo[88204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3 Apr 25 15:53:57 devstack sudo[88204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:57 devstack sudo[88204]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3" returned: 0 in 0.623s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:57 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Image conversion details: src /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3, size 1024.00 MB, duration 4.95 sec, destination /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-73897ef3-80e1-42d1-99fa-9dd812742d03 {{(pid=81828) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 15:53:57 devstack cinder-volume[81828]: INFO cinder.image.image_utils [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Converted 1024.00 MB image at 207.04 MB/s Apr 25 15:53:57 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-73897ef3-80e1-42d1-99fa-9dd812742d03 is being set with open permissions: ugo+rw Apr 25 15:53:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-73897ef3-80e1-42d1-99fa-9dd812742d03 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:57 devstack sudo[88209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-73897ef3-80e1-42d1-99fa-9dd812742d03 Apr 25 15:53:57 devstack sudo[88209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:58 devstack sudo[88209]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-73897ef3-80e1-42d1-99fa-9dd812742d03" returned: 0 in 0.429s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:58 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-quobyte-73897ef3-80e1-42d1-99fa-9dd812742d03" released by "_copy_volume_from_snapshot" :: held 7.233s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:53:58 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-quobyte-258edeca-8b66-427f-b874-f696e4acaf87-73897ef3-80e1-42d1-99fa-9dd812742d03" released by "_create_volume_from_snapshot" :: held 7.272s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:53:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.289s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.575s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:58 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=56359877-fea0-4fd6-84b2-018db392d2c0,created_at=2026-04-25T13:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1808660096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=56359877-fea0-4fd6-84b2-018db392d2c0,host='devstack@QuobyteHD#QuobyteHD',id=819c9ba1-ea8a-4520-9c4d-1a1cb6492613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec41f47e843b441aaa6adf19a8b32b48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:53:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:53:55Z,use_quota=True,user_id='5edf31ca27064c4c9f8d66718d25ff45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a334802-cc7b-4ff1-8862-26a24ec9c216),volume_type_id=7a334802-cc7b-4ff1-8862-26a24ec9c216)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:53:58 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] Creating volume 819c9ba1-ea8a-4520-9c4d-1a1cb6492613 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:53:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:58 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:53:58 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:53:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:58 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:53:58 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:53:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:58 devstack sudo[88212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613 1073741824 Apr 25 15:53:58 devstack sudo[88212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:58 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce80889-798a-493e-9ed2-b753b7ee12e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73897ef3-80e1-42d1-99fa-9dd812742d03', 'volume_size': 1, 'snapshot_id': '258edeca-8b66-427f-b874-f696e4acaf87'}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:58 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c18301a-6663-4d80-a49d-861d2d403b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:58 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Volume volume-73897ef3-80e1-42d1-99fa-9dd812742d03 (73897ef3-80e1-42d1-99fa-9dd812742d03): created successfully Apr 25 15:53:58 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c18301a-6663-4d80-a49d-861d2d403b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:58 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Flow 'volume_create_manager' (4f2d84f9-1fea-41c1-a9dd-1bdf87e4ac75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:53:58 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-f5be4d92-184a-4b26-83c8-3c71d449f246 tempest-VolumesSnapshotTestJSON-1680973878 None] Created volume successfully. Apr 25 15:53:58 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-eef4816d-6d1d-4e52-bfb6-c787189cb3d4 tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "cinder-73897ef3-80e1-42d1-99fa-9dd812742d03-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:53:58 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-eef4816d-6d1d-4e52-bfb6-c787189cb3d4 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-73897ef3-80e1-42d1-99fa-9dd812742d03-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:53:58 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-eef4816d-6d1d-4e52-bfb6-c787189cb3d4 tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "cinder-quobyte-73897ef3-80e1-42d1-99fa-9dd812742d03" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:53:58 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-eef4816d-6d1d-4e52-bfb6-c787189cb3d4 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-quobyte-73897ef3-80e1-42d1-99fa-9dd812742d03" acquired by "delete_volume" :: waited 0.017s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:53:58 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[e096fecc-33d5-4520-b2ec-293d92e8477f]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:53:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-eef4816d-6d1d-4e52-bfb6-c787189cb3d4 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-73897ef3-80e1-42d1-99fa-9dd812742d03 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:58 devstack sudo[88212]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613 1073741824" returned: 0 in 0.629s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:58 devstack sudo[88217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-73897ef3-80e1-42d1-99fa-9dd812742d03 Apr 25 15:53:58 devstack sudo[88217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:58 devstack sudo[88219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613 Apr 25 15:53:58 devstack sudo[88219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:59 devstack sudo[88217]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-eef4816d-6d1d-4e52-bfb6-c787189cb3d4 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-73897ef3-80e1-42d1-99fa-9dd812742d03" returned: 0 in 0.530s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-eef4816d-6d1d-4e52-bfb6-c787189cb3d4 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-73897ef3-80e1-42d1-99fa-9dd812742d03 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:59 devstack sudo[88219]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613" returned: 0 in 0.450s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:59 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:53:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:59 devstack sudo[88225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-73897ef3-80e1-42d1-99fa-9dd812742d03 Apr 25 15:53:59 devstack sudo[88225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:53:59 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ec7f51-384b-47ea-9e0b-10a907b2730f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:59 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26670430-770b-4dad-a411-2ce7fed7d35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:53:59 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] Volume volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613 (819c9ba1-ea8a-4520-9c4d-1a1cb6492613): created successfully Apr 25 15:53:59 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26670430-770b-4dad-a411-2ce7fed7d35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:53:59 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] Flow 'volume_create_manager' (963f3916-e0b5-4bbf-9888-429fe9a60c23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:53:59 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-4298cd4d-8248-439f-b6e5-98dbd20e557f tempest-GroupsV314Test-1329876139 None] Created volume successfully. Apr 25 15:53:59 devstack sudo[88225]: pam_unix(sudo:session): session closed for user root Apr 25 15:53:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-eef4816d-6d1d-4e52-bfb6-c787189cb3d4 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-73897ef3-80e1-42d1-99fa-9dd812742d03" returned: 0 in 0.444s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:53:59 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-eef4816d-6d1d-4e52-bfb6-c787189cb3d4 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-quobyte-73897ef3-80e1-42d1-99fa-9dd812742d03" released by "delete_volume" :: held 1.015s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:53:59 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-eef4816d-6d1d-4e52-bfb6-c787189cb3d4 tempest-VolumesSnapshotTestJSON-1680973878 None] Created reservations ['bf6cf6ed-8541-4cb3-8a28-7938d719644e', '8e3c122c-f086-48b2-8f3a-30e8cd163233', '6bbdd82b-ee11-4e48-9130-e2e2022aa928', 'a18a7efd-533c-4cb3-a2b9-d16ddb328ba8'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:53:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-eef4816d-6d1d-4e52-bfb6-c787189cb3d4 tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:53:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-eef4816d-6d1d-4e52-bfb6-c787189cb3d4 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:53:59 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-eef4816d-6d1d-4e52-bfb6-c787189cb3d4 tempest-VolumesSnapshotTestJSON-1680973878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:53:59 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-eef4816d-6d1d-4e52-bfb6-c787189cb3d4 tempest-VolumesSnapshotTestJSON-1680973878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:53:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-eef4816d-6d1d-4e52-bfb6-c787189cb3d4 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:53:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-eef4816d-6d1d-4e52-bfb6-c787189cb3d4 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:53:59 devstack sudo[88228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:53:59 devstack sudo[88228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:00 devstack cinder-volume[81828]: DEBUG oslo_service.periodic_task [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81828) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 25 15:54:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:54:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:54:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:00 devstack sudo[88231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:54:00 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:00 devstack sudo[88228]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-eef4816d-6d1d-4e52-bfb6-c787189cb3d4 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.450s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:00 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-eef4816d-6d1d-4e52-bfb6-c787189cb3d4 tempest-VolumesSnapshotTestJSON-1680973878 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:54:00 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-eef4816d-6d1d-4e52-bfb6-c787189cb3d4 tempest-VolumesSnapshotTestJSON-1680973878 None] Deleted volume successfully. Apr 25 15:54:00 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-eef4816d-6d1d-4e52-bfb6-c787189cb3d4 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-73897ef3-80e1-42d1-99fa-9dd812742d03-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:00 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.435s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:00 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:54:00 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-92f070d4-7579-4910-855c-bf489fb27e35 tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "cinder-258edeca-8b66-427f-b874-f696e4acaf87-delete_snapshot" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:00 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-92f070d4-7579-4910-855c-bf489fb27e35 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-258edeca-8b66-427f-b874-f696e4acaf87-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:00 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-92f070d4-7579-4910-855c-bf489fb27e35 tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "cinder-quobyte-26a1a73f-c398-441d-b8a0-825b0a9001d3" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:00 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-92f070d4-7579-4910-855c-bf489fb27e35 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-quobyte-26a1a73f-c398-441d-b8a0-825b0a9001d3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:00 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-92f070d4-7579-4910-855c-bf489fb27e35 tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "cinder-quobyte-258edeca-8b66-427f-b874-f696e4acaf87" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:01 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-92f070d4-7579-4910-855c-bf489fb27e35 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-quobyte-258edeca-8b66-427f-b874-f696e4acaf87" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:01 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-92f070d4-7579-4910-855c-bf489fb27e35 tempest-VolumesSnapshotTestJSON-1680973878 None] Deleting offline snapshot 258edeca-8b66-427f-b874-f696e4acaf87 of volume 26a1a73f-c398-441d-b8a0-825b0a9001d3 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 15:54:01 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-92f070d4-7579-4910-855c-bf489fb27e35 tempest-VolumesSnapshotTestJSON-1680973878 None] snapshot_file for this snap is: volume-26a1a73f-c398-441d-b8a0-825b0a9001d3.258edeca-8b66-427f-b874-f696e4acaf87 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 15:54:01 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[effd2f58-97ca-4199-91d7-6c8d6917fd61]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:54:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-92f070d4-7579-4910-855c-bf489fb27e35 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3.258edeca-8b66-427f-b874-f696e4acaf87 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:01 devstack sudo[88234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3.258edeca-8b66-427f-b874-f696e4acaf87 Apr 25 15:54:01 devstack sudo[88234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:01 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Cloning volume 819c9ba1-ea8a-4520-9c4d-1a1cb6492613 to volume a427b446-9276-4ce4-bede-c824fcd4fb09 Apr 25 15:54:01 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Creating offline snapshot 1a8c0080-c5f9-4456-9bab-c44253ca2ce6 of volume 819c9ba1-ea8a-4520-9c4d-1a1cb6492613 {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 15:54:01 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[760cc32e-2c41-4e5e-a413-29d0fee42e2b]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:54:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:01 devstack sudo[88236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613 Apr 25 15:54:01 devstack sudo[88236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:01 devstack sudo[88234]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-92f070d4-7579-4910-855c-bf489fb27e35 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3.258edeca-8b66-427f-b874-f696e4acaf87" returned: 0 in 0.519s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:01 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-92f070d4-7579-4910-855c-bf489fb27e35 tempest-VolumesSnapshotTestJSON-1680973878 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26a1a73f-c398-441d-b8a0-825b0a9001d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:54:01 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a93469-b39c-4869-9377-00fdcbb71891]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:54:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-92f070d4-7579-4910-855c-bf489fb27e35 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:01 devstack sudo[88242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3 Apr 25 15:54:01 devstack sudo[88242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:01 devstack sudo[88236]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613" returned: 0 in 0.526s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613.1a8c0080-c5f9-4456-9bab-c44253ca2ce6 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:01 devstack sudo[88247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613.1a8c0080-c5f9-4456-9bab-c44253ca2ce6 1G Apr 25 15:54:01 devstack sudo[88247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:02 devstack sudo[88242]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-92f070d4-7579-4910-855c-bf489fb27e35 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3" returned: 0 in 0.521s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-92f070d4-7579-4910-855c-bf489fb27e35 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3.258edeca-8b66-427f-b874-f696e4acaf87 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:02 devstack sudo[88255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3.258edeca-8b66-427f-b874-f696e4acaf87 Apr 25 15:54:02 devstack sudo[88255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:02 devstack sudo[88247]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613.1a8c0080-c5f9-4456-9bab-c44253ca2ce6 1G" returned: 0 in 0.603s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613.1a8c0080-c5f9-4456-9bab-c44253ca2ce6 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:02 devstack sudo[88257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613.1a8c0080-c5f9-4456-9bab-c44253ca2ce6 Apr 25 15:54:02 devstack sudo[88257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:02 devstack sudo[88255]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-92f070d4-7579-4910-855c-bf489fb27e35 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3.258edeca-8b66-427f-b874-f696e4acaf87" returned: 0 in 0.546s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-92f070d4-7579-4910-855c-bf489fb27e35 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3.258edeca-8b66-427f-b874-f696e4acaf87 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:02 devstack sudo[88262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3.258edeca-8b66-427f-b874-f696e4acaf87 Apr 25 15:54:02 devstack sudo[88262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:02 devstack sudo[88257]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613.1a8c0080-c5f9-4456-9bab-c44253ca2ce6" returned: 0 in 0.510s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:02 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613.1a8c0080-c5f9-4456-9bab-c44253ca2ce6 is being set with open permissions: ugo+rw: NotImplementedError Apr 25 15:54:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613.1a8c0080-c5f9-4456-9bab-c44253ca2ce6 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:02 devstack sudo[88267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613.1a8c0080-c5f9-4456-9bab-c44253ca2ce6 Apr 25 15:54:02 devstack sudo[88267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:03 devstack sudo[88262]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-92f070d4-7579-4910-855c-bf489fb27e35 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3.258edeca-8b66-427f-b874-f696e4acaf87" returned: 0 in 0.440s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:03 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:SELECT=154,cinder:UPDATE=154,cinder:DELETE=14,cinder:INSERT=36 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:54:03 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:SELECT=143,cinder:UPDATE=175,cinder:INSERT=40,cinder:DELETE=12 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:54:03 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-92f070d4-7579-4910-855c-bf489fb27e35 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-quobyte-258edeca-8b66-427f-b874-f696e4acaf87" released by "_delete_snapshot" :: held 2.154s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:03 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-92f070d4-7579-4910-855c-bf489fb27e35 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-quobyte-26a1a73f-c398-441d-b8a0-825b0a9001d3" released by "delete_snapshot" :: held 2.175s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:03 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-92f070d4-7579-4910-855c-bf489fb27e35 tempest-VolumesSnapshotTestJSON-1680973878 None] Created reservations ['f6132e44-998a-470c-9191-b058c8ec141e', '09ae79b4-53d9-4d2b-aa05-3b6f4267d6ff', '149a252f-f5fe-41d3-bc14-1b917f051389', 'd7dd9aac-5355-4590-9b5a-aee2d45f33b1'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:54:03 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-92f070d4-7579-4910-855c-bf489fb27e35 tempest-VolumesSnapshotTestJSON-1680973878 None] Delete snapshot completed successfully. Apr 25 15:54:03 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-92f070d4-7579-4910-855c-bf489fb27e35 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-258edeca-8b66-427f-b874-f696e4acaf87-delete_snapshot" released by "delete_snapshot" :: held 2.306s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:03 devstack sudo[88267]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613.1a8c0080-c5f9-4456-9bab-c44253ca2ce6" returned: 0 in 0.480s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:03 devstack sudo[88272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613.info Apr 25 15:54:03 devstack sudo[88272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:03 devstack sudo[88272]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613.info" returned: 0 in 0.457s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:03 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613.info is being set with open permissions: ugo+rw: NotImplementedError Apr 25 15:54:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:03 devstack sudo[88275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613.info Apr 25 15:54:03 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:04 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-717dd93a-24cf-46ba-b114-55d9e4869887 tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "cinder-26a1a73f-c398-441d-b8a0-825b0a9001d3-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:04 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-717dd93a-24cf-46ba-b114-55d9e4869887 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-26a1a73f-c398-441d-b8a0-825b0a9001d3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:04 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613.info" returned: 0 in 0.473s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:04 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Acquiring lock "cinder-quobyte-a427b446-9276-4ce4-bede-c824fcd4fb09" by "_copy_volume_from_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:04 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Lock "cinder-quobyte-a427b446-9276-4ce4-bede-c824fcd4fb09" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:04 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] snapshot: 1a8c0080-c5f9-4456-9bab-c44253ca2ce6, volume: a427b446-9276-4ce4-bede-c824fcd4fb09, {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 25 15:54:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:04 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:54:04 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:54:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:04 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-717dd93a-24cf-46ba-b114-55d9e4869887 tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "cinder-quobyte-26a1a73f-c398-441d-b8a0-825b0a9001d3" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:04 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5d2c20-9b2c-475e-8708-f7681309f5a6]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:54:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613.1a8c0080-c5f9-4456-9bab-c44253ca2ce6 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:04 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-717dd93a-24cf-46ba-b114-55d9e4869887 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-quobyte-26a1a73f-c398-441d-b8a0-825b0a9001d3" acquired by "delete_volume" :: waited 0.033s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:04 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e222d3-6862-4b18-aba1-ef7d1b73e833]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:54:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-717dd93a-24cf-46ba-b114-55d9e4869887 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:04 devstack sudo[88278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613.1a8c0080-c5f9-4456-9bab-c44253ca2ce6 Apr 25 15:54:04 devstack sudo[88278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:04 devstack sudo[88279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3 Apr 25 15:54:04 devstack sudo[88279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:04 devstack sudo[88278]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613.1a8c0080-c5f9-4456-9bab-c44253ca2ce6" returned: 0 in 0.567s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:04 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:54:04 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] will copy from snapshot at /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613 {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 25 15:54:04 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Creating direct copy from snapshot {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 25 15:54:04 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fed804-84da-4d7f-95a6-de499e8fb229]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:54:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:04 devstack sudo[88279]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-717dd93a-24cf-46ba-b114-55d9e4869887 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3" returned: 0 in 0.558s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-717dd93a-24cf-46ba-b114-55d9e4869887 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:05 devstack sudo[88289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3 Apr 25 15:54:05 devstack sudo[88289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:05 devstack sudo[88288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613 Apr 25 15:54:05 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:05 devstack sudo[88289]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:05 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-717dd93a-24cf-46ba-b114-55d9e4869887 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-26a1a73f-c398-441d-b8a0-825b0a9001d3" returned: 0 in 0.477s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613" returned: 0 in 0.527s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:05 devstack cinder-volume[81828]: DEBUG cinder.utils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Path /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a427b446-9276-4ce4-bede-c824fcd4fb09 not found in is_blk_device check {{(pid=81828) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 25 15:54:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a427b446-9276-4ce4-bede-c824fcd4fb09 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:05 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-717dd93a-24cf-46ba-b114-55d9e4869887 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-quobyte-26a1a73f-c398-441d-b8a0-825b0a9001d3" released by "delete_volume" :: held 1.099s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:05 devstack sudo[88296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a427b446-9276-4ce4-bede-c824fcd4fb09 Apr 25 15:54:05 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:05 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-717dd93a-24cf-46ba-b114-55d9e4869887 tempest-VolumesSnapshotTestJSON-1680973878 None] Created reservations ['3882466c-72e3-4e7c-bbbb-9a80749bffd8', '2ab1423e-9ca7-4124-a109-eef045ca58fc', 'c931d765-1bfa-4b5c-bb33-e955e4e9334a', '90096915-8172-44e8-9172-edbd16cef281'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:54:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-717dd93a-24cf-46ba-b114-55d9e4869887 tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-717dd93a-24cf-46ba-b114-55d9e4869887 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:05 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-717dd93a-24cf-46ba-b114-55d9e4869887 tempest-VolumesSnapshotTestJSON-1680973878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:54:05 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-717dd93a-24cf-46ba-b114-55d9e4869887 tempest-VolumesSnapshotTestJSON-1680973878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:54:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-717dd93a-24cf-46ba-b114-55d9e4869887 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-717dd93a-24cf-46ba-b114-55d9e4869887 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:05 devstack sudo[88298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:54:05 devstack sudo[88298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:06 devstack sudo[88298]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-717dd93a-24cf-46ba-b114-55d9e4869887 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.518s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:06 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-717dd93a-24cf-46ba-b114-55d9e4869887 tempest-VolumesSnapshotTestJSON-1680973878 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:54:06 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-717dd93a-24cf-46ba-b114-55d9e4869887 tempest-VolumesSnapshotTestJSON-1680973878 None] Deleted volume successfully. Apr 25 15:54:06 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-717dd93a-24cf-46ba-b114-55d9e4869887 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-26a1a73f-c398-441d-b8a0-825b0a9001d3-delete_volume" released by "delete_volume" :: held 1.974s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:06 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-29d68efa-8395-4e89-82bd-b4d69899b159 tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "cinder-52560221-3fdb-48b2-b76f-72f286d5188d-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:06 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-29d68efa-8395-4e89-82bd-b4d69899b159 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-52560221-3fdb-48b2-b76f-72f286d5188d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:06 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-29d68efa-8395-4e89-82bd-b4d69899b159 tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "cinder-quobyte-52560221-3fdb-48b2-b76f-72f286d5188d" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:06 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-29d68efa-8395-4e89-82bd-b4d69899b159 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-quobyte-52560221-3fdb-48b2-b76f-72f286d5188d" acquired by "delete_volume" :: waited 0.028s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:06 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[659794e4-fb74-4343-8fed-47176b6ff93f]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:54:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-29d68efa-8395-4e89-82bd-b4d69899b159 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:07 devstack sudo[88311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d Apr 25 15:54:07 devstack sudo[88311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:07 devstack sudo[88311]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-29d68efa-8395-4e89-82bd-b4d69899b159 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d" returned: 0 in 0.970s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-29d68efa-8395-4e89-82bd-b4d69899b159 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:07 devstack sudo[88316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d Apr 25 15:54:07 devstack sudo[88316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:08 devstack sudo[88316]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-29d68efa-8395-4e89-82bd-b4d69899b159 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-52560221-3fdb-48b2-b76f-72f286d5188d" returned: 0 in 0.725s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:08 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-29d68efa-8395-4e89-82bd-b4d69899b159 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-quobyte-52560221-3fdb-48b2-b76f-72f286d5188d" released by "delete_volume" :: held 1.825s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:08 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-29d68efa-8395-4e89-82bd-b4d69899b159 tempest-VolumesSnapshotTestJSON-1680973878 None] Created reservations ['e8a75ebd-94b4-4c55-a9d0-5e67b33b9088', '1d835087-de69-4638-b59f-776ad83ceaa8', '0ad418f1-fd95-43bb-ac96-77fb7a05820c', 'a65cd539-5a86-48c7-9061-960b2f43c727'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:54:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-29d68efa-8395-4e89-82bd-b4d69899b159 tempest-VolumesSnapshotTestJSON-1680973878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-29d68efa-8395-4e89-82bd-b4d69899b159 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:08 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-29d68efa-8395-4e89-82bd-b4d69899b159 tempest-VolumesSnapshotTestJSON-1680973878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:54:08 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-29d68efa-8395-4e89-82bd-b4d69899b159 tempest-VolumesSnapshotTestJSON-1680973878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:54:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-29d68efa-8395-4e89-82bd-b4d69899b159 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-29d68efa-8395-4e89-82bd-b4d69899b159 tempest-VolumesSnapshotTestJSON-1680973878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:08 devstack sudo[88319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:54:08 devstack sudo[88319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:09 devstack sudo[88319]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-29d68efa-8395-4e89-82bd-b4d69899b159 tempest-VolumesSnapshotTestJSON-1680973878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.813s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:09 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-29d68efa-8395-4e89-82bd-b4d69899b159 tempest-VolumesSnapshotTestJSON-1680973878 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:54:09 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-29d68efa-8395-4e89-82bd-b4d69899b159 tempest-VolumesSnapshotTestJSON-1680973878 None] Deleted volume successfully. Apr 25 15:54:09 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-29d68efa-8395-4e89-82bd-b4d69899b159 tempest-VolumesSnapshotTestJSON-1680973878 None] Lock "cinder-52560221-3fdb-48b2-b76f-72f286d5188d-delete_volume" released by "delete_volume" :: held 3.007s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:10 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a427b446-9276-4ce4-bede-c824fcd4fb09" returned: 0 in 5.252s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:10 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebbce73-06d3-41c7-8688-1bb791ac1b68]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:54:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:10 devstack sudo[88322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613 Apr 25 15:54:10 devstack sudo[88322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:11 devstack sudo[88322]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613" returned: 0 in 0.717s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:11 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Image conversion details: src /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613, size 1024.00 MB, duration 5.25 sec, destination /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a427b446-9276-4ce4-bede-c824fcd4fb09 {{(pid=81828) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 15:54:11 devstack cinder-volume[81828]: INFO cinder.image.image_utils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Converted 1024.00 MB image at 194.93 MB/s Apr 25 15:54:11 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a427b446-9276-4ce4-bede-c824fcd4fb09 is being set with open permissions: ugo+rw: NotImplementedError Apr 25 15:54:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a427b446-9276-4ce4-bede-c824fcd4fb09 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:11 devstack sudo[88363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a427b446-9276-4ce4-bede-c824fcd4fb09 Apr 25 15:54:11 devstack sudo[88363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:11 devstack sudo[88363]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a427b446-9276-4ce4-bede-c824fcd4fb09" returned: 0 in 0.510s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:11 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Lock "cinder-quobyte-a427b446-9276-4ce4-bede-c824fcd4fb09" released by "_copy_volume_from_snapshot" :: held 7.656s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:11 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Acquiring lock "cinder-quobyte-1a8c0080-c5f9-4456-9bab-c44253ca2ce6" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:12 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Lock "cinder-quobyte-1a8c0080-c5f9-4456-9bab-c44253ca2ce6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:12 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Deleting offline snapshot 1a8c0080-c5f9-4456-9bab-c44253ca2ce6 of volume 819c9ba1-ea8a-4520-9c4d-1a1cb6492613 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 15:54:12 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] snapshot_file for this snap is: volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613.1a8c0080-c5f9-4456-9bab-c44253ca2ce6 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 15:54:12 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[897fe2cb-739a-4a40-b774-99c79e378245]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:54:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613.1a8c0080-c5f9-4456-9bab-c44253ca2ce6 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:12 devstack sudo[88366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613.1a8c0080-c5f9-4456-9bab-c44253ca2ce6 Apr 25 15:54:12 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:12 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613.1a8c0080-c5f9-4456-9bab-c44253ca2ce6" returned: 0 in 0.551s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:12 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:54:12 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d61a769-25fa-4ff4-95bd-0ec517d3eaf9]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:54:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:12 devstack sudo[88371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613 Apr 25 15:54:12 devstack sudo[88371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:13 devstack sudo[88371]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613" returned: 0 in 0.650s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613.1a8c0080-c5f9-4456-9bab-c44253ca2ce6 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:13 devstack sudo[88377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613.1a8c0080-c5f9-4456-9bab-c44253ca2ce6 Apr 25 15:54:13 devstack sudo[88377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:13 devstack sudo[88377]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613.1a8c0080-c5f9-4456-9bab-c44253ca2ce6" returned: 0 in 0.605s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613.1a8c0080-c5f9-4456-9bab-c44253ca2ce6 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:13 devstack sudo[88382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613.1a8c0080-c5f9-4456-9bab-c44253ca2ce6 Apr 25 15:54:13 devstack sudo[88382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:14 devstack sudo[88382]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613.1a8c0080-c5f9-4456-9bab-c44253ca2ce6" returned: 0 in 0.494s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:14 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Lock "cinder-quobyte-1a8c0080-c5f9-4456-9bab-c44253ca2ce6" released by "_delete_snapshot" :: held 2.399s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.292s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:14 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-3a2879ba-fee2-4eff-b694-099df6e6cbf0 tempest-GroupsV314Test-1329876139 None] Create group from source-group-56359877-fea0-4fd6-84b2-018db392d2c0 completed successfully. Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] Flow 'volume_create_manager' (1e49d4dd-29dd-4cfd-91cf-3fb89faeaf5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c32db32-cc57-4783-b1d3-92542fb2d49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c32db32-cc57-4783-b1d3-92542fb2d49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1712714163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a21d7ce0-899f-45f1-a72d-347d846408dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e0eb07f991e4714b93869fad6090270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:54:15Z,use_quota=True,user_id='3934e6d681834012a06834163d63ee13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (003aa01f-6855-4583-8cff-b076a3b02010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (003aa01f-6855-4583-8cff-b076a3b02010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cabc808-3e68-4966-a7cc-0910b2ba7cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cabc808-3e68-4966-a7cc-0910b2ba7cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a21d7ce0-899f-45f1-a72d-347d846408dc', 'volume_name': 'volume-a21d7ce0-899f-45f1-a72d-347d846408dc', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6386794-2cc9-4381-a46e-bab48ed89c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6386794-2cc9-4381-a46e-bab48ed89c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ec89ad-14ad-415c-913f-c5212b03e483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:15 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] Volume a21d7ce0-899f-45f1-a72d-347d846408dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a21d7ce0-899f-45f1-a72d-347d846408dc', 'volume_size': 1} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1712714163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a21d7ce0-899f-45f1-a72d-347d846408dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e0eb07f991e4714b93869fad6090270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:54:15Z,use_quota=True,user_id='3934e6d681834012a06834163d63ee13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] Creating volume a21d7ce0-899f-45f1-a72d-347d846408dc {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:54:15 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a21d7ce0-899f-45f1-a72d-347d846408dc 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:15 devstack sudo[88385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a21d7ce0-899f-45f1-a72d-347d846408dc 1073741824 Apr 25 15:54:15 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fb44e4d2-69c6-49f4-a143-fc892c543072 tempest-GroupsV314Test-1329876139 None] Acquiring lock "cinder-quobyte-a427b446-9276-4ce4-bede-c824fcd4fb09" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fb44e4d2-69c6-49f4-a143-fc892c543072 tempest-GroupsV314Test-1329876139 None] Lock "cinder-quobyte-a427b446-9276-4ce4-bede-c824fcd4fb09" acquired by "delete_volume" :: waited 0.030s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[4daaaa9b-fc1f-4182-aa50-248bbd9d890a]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fb44e4d2-69c6-49f4-a143-fc892c543072 tempest-GroupsV314Test-1329876139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a427b446-9276-4ce4-bede-c824fcd4fb09 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:54:15 devstack sudo[88387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a427b446-9276-4ce4-bede-c824fcd4fb09 Apr 25 15:54:15 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] Flow 'volume_create_manager' (5973662d-3d0b-4877-a534-505a4f9e3994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66a70c7f-bebd-4914-a835-db0a0d9b0cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66a70c7f-bebd-4914-a835-db0a0d9b0cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1904727264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f015ad0-be6c-4877-8425-f8d8f4c58e9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e0eb07f991e4714b93869fad6090270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:54:15Z,use_quota=True,user_id='3934e6d681834012a06834163d63ee13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63355a49-2020-4e78-87d5-1dc977d40f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63355a49-2020-4e78-87d5-1dc977d40f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a4e4a6-6e90-44ab-ae5b-8d1eff0c235c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a4e4a6-6e90-44ab-ae5b-8d1eff0c235c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f015ad0-be6c-4877-8425-f8d8f4c58e9a', 'volume_name': 'volume-6f015ad0-be6c-4877-8425-f8d8f4c58e9a', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fb5024a-ad2c-4f8c-a7ec-6c2deb56e9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fb5024a-ad2c-4f8c-a7ec-6c2deb56e9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b10ea9f6-c2c9-4787-b344-6f50bf09201b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:15 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] Volume 6f015ad0-be6c-4877-8425-f8d8f4c58e9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f015ad0-be6c-4877-8425-f8d8f4c58e9a', 'volume_size': 1} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] Flow 'volume_create_manager' (4eb9070a-b972-48e6-85b1-5cdd09f12012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (306de601-0eba-4ee6-9969-e7806836a030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (306de601-0eba-4ee6-9969-e7806836a030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1921555213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0b8be57-2acf-418a-b061-80c181a33dc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e0eb07f991e4714b93869fad6090270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:54:16Z,use_quota=True,user_id='3934e6d681834012a06834163d63ee13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c5b044f-95d1-4734-b527-bd7befc83265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c5b044f-95d1-4734-b527-bd7befc83265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ea87f9-39b1-4fe0-a407-887b9935aced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ea87f9-39b1-4fe0-a407-887b9935aced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0b8be57-2acf-418a-b061-80c181a33dc7', 'volume_name': 'volume-c0b8be57-2acf-418a-b061-80c181a33dc7', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a79383a-bb24-437b-b51c-0f28b8f497da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a79383a-bb24-437b-b51c-0f28b8f497da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e962ba71-5933-499b-b3f3-2ad7cd15f844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:15 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] Volume c0b8be57-2acf-418a-b061-80c181a33dc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0b8be57-2acf-418a-b061-80c181a33dc7', 'volume_size': 1} Apr 25 15:54:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:16 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:54:16 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] Flow 'volume_create_manager' (f6dd55b7-5334-4089-ae19-04d88be266d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f38cfc-e079-4b57-b45b-c428930e202f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fb44e4d2-69c6-49f4-a143-fc892c543072 tempest-GroupsV314Test-1329876139 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a427b446-9276-4ce4-bede-c824fcd4fb09" returned: 0 in 0.724s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a21d7ce0-899f-45f1-a72d-347d846408dc 1073741824" returned: 0 in 0.876s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fb44e4d2-69c6-49f4-a143-fc892c543072 tempest-GroupsV314Test-1329876139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a427b446-9276-4ce4-bede-c824fcd4fb09 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:16 devstack sudo[88395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a427b446-9276-4ce4-bede-c824fcd4fb09 Apr 25 15:54:16 devstack sudo[88395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f38cfc-e079-4b57-b45b-c428930e202f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-208377245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fa20e8a-069d-4e52-b5bd-ed76e33d4890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e0eb07f991e4714b93869fad6090270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:54:16Z,use_quota=True,user_id='3934e6d681834012a06834163d63ee13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c9a79ad-0c40-41e2-a145-2448258d73ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c9a79ad-0c40-41e2-a145-2448258d73ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3999e69-6b70-4418-94be-cddd1d91516e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3999e69-6b70-4418-94be-cddd1d91516e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fa20e8a-069d-4e52-b5bd-ed76e33d4890', 'volume_name': 'volume-1fa20e8a-069d-4e52-b5bd-ed76e33d4890', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18562331-f36a-49b1-ab73-df1a482ec124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18562331-f36a-49b1-ab73-df1a482ec124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d926b5bb-d143-490c-9db3-d2d494850500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:16 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] Volume 1fa20e8a-069d-4e52-b5bd-ed76e33d4890: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fa20e8a-069d-4e52-b5bd-ed76e33d4890', 'volume_size': 1} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a21d7ce0-899f-45f1-a72d-347d846408dc {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:16 devstack sudo[88397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a21d7ce0-899f-45f1-a72d-347d846408dc Apr 25 15:54:16 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] Flow 'volume_create_manager' (e6284088-446f-40c6-8c18-b00f33d4f5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dad716a-3e69-4107-b5aa-b6147ce74707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dad716a-3e69-4107-b5aa-b6147ce74707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-340458934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faef3e28-6c12-4c7b-9761-761fec9c507b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e0eb07f991e4714b93869fad6090270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:54:16Z,use_quota=True,user_id='3934e6d681834012a06834163d63ee13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4c43b9-5148-41ca-934f-647ab27bb548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4c43b9-5148-41ca-934f-647ab27bb548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fa67304-6afe-452b-9e7b-93f81079fe70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fa67304-6afe-452b-9e7b-93f81079fe70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faef3e28-6c12-4c7b-9761-761fec9c507b', 'volume_name': 'volume-faef3e28-6c12-4c7b-9761-761fec9c507b', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e777bca-6ec4-4ba7-8360-b0798205dfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e777bca-6ec4-4ba7-8360-b0798205dfd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08ed46b-afe6-49fa-982a-6b4bece038b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:16 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] Volume faef3e28-6c12-4c7b-9761-761fec9c507b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faef3e28-6c12-4c7b-9761-761fec9c507b', 'volume_size': 1} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:16 devstack sudo[88395]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fb44e4d2-69c6-49f4-a143-fc892c543072 tempest-GroupsV314Test-1329876139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a427b446-9276-4ce4-bede-c824fcd4fb09" returned: 0 in 0.470s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fb44e4d2-69c6-49f4-a143-fc892c543072 tempest-GroupsV314Test-1329876139 None] Lock "cinder-quobyte-a427b446-9276-4ce4-bede-c824fcd4fb09" released by "delete_volume" :: held 1.242s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-fb44e4d2-69c6-49f4-a143-fc892c543072 tempest-GroupsV314Test-1329876139 None] Created reservations ['03dbd02b-1e0b-4008-a31d-f299d0aa1bc9'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:54:16 devstack cinder-volume[81828]: WARNING cinder.quota [None req-fb44e4d2-69c6-49f4-a143-fc892c543072 tempest-GroupsV314Test-1329876139 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1713650630 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1713650630, it is now deprecated. Please use the default quota class for default quota. Apr 25 15:54:16 devstack cinder-volume[81828]: WARNING cinder.quota [None req-fb44e4d2-69c6-49f4-a143-fc892c543072 tempest-GroupsV314Test-1329876139 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1713650630 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1713650630, it is now deprecated. Please use the default quota class for default quota. Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-fb44e4d2-69c6-49f4-a143-fc892c543072 tempest-GroupsV314Test-1329876139 None] Created reservations ['f97ad34c-6717-41bb-93ae-d0827207fddb', 'd3630f41-9d4c-4015-9c45-c139f6058908', '774cd1fa-0569-468f-85fd-736f47c408ce', 'efab71a9-be19-4316-9875-da3c3293100f'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:54:16 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a21d7ce0-899f-45f1-a72d-347d846408dc" returned: 0 in 0.559s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.172s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1904727264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f015ad0-be6c-4877-8425-f8d8f4c58e9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e0eb07f991e4714b93869fad6090270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:54:15Z,use_quota=True,user_id='3934e6d681834012a06834163d63ee13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] Creating volume 6f015ad0-be6c-4877-8425-f8d8f4c58e9a {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:54:16 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6f015ad0-be6c-4877-8425-f8d8f4c58e9a 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ec89ad-14ad-415c-913f-c5212b03e483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a21d7ce0-899f-45f1-a72d-347d846408dc', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:16 devstack sudo[88401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6f015ad0-be6c-4877-8425-f8d8f4c58e9a 1073741824 Apr 25 15:54:16 devstack sudo[88401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a862fbba-e98b-4e8a-b694-8f059c94ec38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fb44e4d2-69c6-49f4-a143-fc892c543072 tempest-GroupsV314Test-1329876139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fb44e4d2-69c6-49f4-a143-fc892c543072 tempest-GroupsV314Test-1329876139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-fb44e4d2-69c6-49f4-a143-fc892c543072 tempest-GroupsV314Test-1329876139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-fb44e4d2-69c6-49f4-a143-fc892c543072 tempest-GroupsV314Test-1329876139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fb44e4d2-69c6-49f4-a143-fc892c543072 tempest-GroupsV314Test-1329876139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fb44e4d2-69c6-49f4-a143-fc892c543072 tempest-GroupsV314Test-1329876139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:16 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] Volume volume-a21d7ce0-899f-45f1-a72d-347d846408dc (a21d7ce0-899f-45f1-a72d-347d846408dc): created successfully Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a862fbba-e98b-4e8a-b694-8f059c94ec38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] Flow 'volume_create_manager' (1e49d4dd-29dd-4cfd-91cf-3fb89faeaf5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:54:16 devstack sudo[88403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:54:16 devstack sudo[88403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:16 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-42352eec-865c-4714-bbfb-00d26640043b tempest-CreateVolumesFromImageTest-593189135 None] Created volume successfully. Apr 25 15:54:17 devstack sudo[88403]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fb44e4d2-69c6-49f4-a143-fc892c543072 tempest-GroupsV314Test-1329876139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.449s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:17 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-fb44e4d2-69c6-49f4-a143-fc892c543072 tempest-GroupsV314Test-1329876139 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:54:17 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-fb44e4d2-69c6-49f4-a143-fc892c543072 tempest-GroupsV314Test-1329876139 None] Delete group completed successfully. Apr 25 15:54:17 devstack sudo[88401]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6f015ad0-be6c-4877-8425-f8d8f4c58e9a 1073741824" returned: 0 in 0.632s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6f015ad0-be6c-4877-8425-f8d8f4c58e9a {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:17 devstack sudo[88409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6f015ad0-be6c-4877-8425-f8d8f4c58e9a Apr 25 15:54:17 devstack sudo[88409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:17 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e24b04ab-0429-4117-9ce7-c4d884828b26 tempest-GroupsV314Test-1329876139 None] Acquiring lock "cinder-quobyte-819c9ba1-ea8a-4520-9c4d-1a1cb6492613" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:17 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e24b04ab-0429-4117-9ce7-c4d884828b26 tempest-GroupsV314Test-1329876139 None] Lock "cinder-quobyte-819c9ba1-ea8a-4520-9c4d-1a1cb6492613" acquired by "delete_volume" :: waited 0.015s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:17 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df789b2-4f52-404f-82b2-b8a696ca706e]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:54:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e24b04ab-0429-4117-9ce7-c4d884828b26 tempest-GroupsV314Test-1329876139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:17 devstack sudo[88411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613 Apr 25 15:54:17 devstack sudo[88411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:17 devstack sudo[88409]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6f015ad0-be6c-4877-8425-f8d8f4c58e9a" returned: 0 in 0.474s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:17 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:54:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.080s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:17 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1921555213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0b8be57-2acf-418a-b061-80c181a33dc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e0eb07f991e4714b93869fad6090270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:54:16Z,use_quota=True,user_id='3934e6d681834012a06834163d63ee13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:54:17 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] Creating volume c0b8be57-2acf-418a-b061-80c181a33dc7 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:54:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:17 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:54:17 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:54:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:17 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:54:17 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:54:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c0b8be57-2acf-418a-b061-80c181a33dc7 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:17 devstack sudo[88414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c0b8be57-2acf-418a-b061-80c181a33dc7 1073741824 Apr 25 15:54:17 devstack sudo[88414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:17 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b10ea9f6-c2c9-4787-b344-6f50bf09201b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f015ad0-be6c-4877-8425-f8d8f4c58e9a', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:17 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a532bd8f-529a-4329-b46a-c96c3dcd5ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:17 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] Volume volume-6f015ad0-be6c-4877-8425-f8d8f4c58e9a (6f015ad0-be6c-4877-8425-f8d8f4c58e9a): created successfully Apr 25 15:54:17 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a532bd8f-529a-4329-b46a-c96c3dcd5ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:17 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] Flow 'volume_create_manager' (5973662d-3d0b-4877-a534-505a4f9e3994) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:54:17 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-9ba03969-afc8-4179-80d7-42a37e4e1152 tempest-CreateVolumesFromImageTest-593189135 None] Created volume successfully. Apr 25 15:54:18 devstack sudo[88411]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e24b04ab-0429-4117-9ce7-c4d884828b26 tempest-GroupsV314Test-1329876139 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613" returned: 0 in 0.535s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e24b04ab-0429-4117-9ce7-c4d884828b26 tempest-GroupsV314Test-1329876139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:18 devstack sudo[88420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613 Apr 25 15:54:18 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:18 devstack sudo[88414]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c0b8be57-2acf-418a-b061-80c181a33dc7 1073741824" returned: 0 in 0.628s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c0b8be57-2acf-418a-b061-80c181a33dc7 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:18 devstack sudo[88424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c0b8be57-2acf-418a-b061-80c181a33dc7 Apr 25 15:54:18 devstack sudo[88424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:18 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e24b04ab-0429-4117-9ce7-c4d884828b26 tempest-GroupsV314Test-1329876139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-819c9ba1-ea8a-4520-9c4d-1a1cb6492613" returned: 0 in 0.520s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:18 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e24b04ab-0429-4117-9ce7-c4d884828b26 tempest-GroupsV314Test-1329876139 None] Lock "cinder-quobyte-819c9ba1-ea8a-4520-9c4d-1a1cb6492613" released by "delete_volume" :: held 1.116s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:18 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-e24b04ab-0429-4117-9ce7-c4d884828b26 tempest-GroupsV314Test-1329876139 None] Created reservations ['f6bd880f-533a-410a-8bfd-4dbff22c9089'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:54:18 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-e24b04ab-0429-4117-9ce7-c4d884828b26 tempest-GroupsV314Test-1329876139 None] Created reservations ['c511dc64-d5d0-4419-b015-658183ff2fde', '62918c84-f0f1-442d-b852-ca871cba8632', 'fe8db97e-1735-4675-97de-461ddfe3770d', '29e33a38-9d8a-43f9-8568-e6eba475a21f'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:54:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e24b04ab-0429-4117-9ce7-c4d884828b26 tempest-GroupsV314Test-1329876139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e24b04ab-0429-4117-9ce7-c4d884828b26 tempest-GroupsV314Test-1329876139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:18 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e24b04ab-0429-4117-9ce7-c4d884828b26 tempest-GroupsV314Test-1329876139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:54:18 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e24b04ab-0429-4117-9ce7-c4d884828b26 tempest-GroupsV314Test-1329876139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:54:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e24b04ab-0429-4117-9ce7-c4d884828b26 tempest-GroupsV314Test-1329876139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e24b04ab-0429-4117-9ce7-c4d884828b26 tempest-GroupsV314Test-1329876139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:19 devstack sudo[88428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:54:19 devstack sudo[88428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:19 devstack sudo[88424]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c0b8be57-2acf-418a-b061-80c181a33dc7" returned: 0 in 0.463s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:54:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.871s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-208377245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fa20e8a-069d-4e52-b5bd-ed76e33d4890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e0eb07f991e4714b93869fad6090270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:54:16Z,use_quota=True,user_id='3934e6d681834012a06834163d63ee13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:54:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] Creating volume 1fa20e8a-069d-4e52-b5bd-ed76e33d4890 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:54:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:54:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:54:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:54:19 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:54:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1fa20e8a-069d-4e52-b5bd-ed76e33d4890 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e962ba71-5933-499b-b3f3-2ad7cd15f844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0b8be57-2acf-418a-b061-80c181a33dc7', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:19 devstack sudo[88430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1fa20e8a-069d-4e52-b5bd-ed76e33d4890 1073741824 Apr 25 15:54:19 devstack sudo[88430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (779a042f-6148-4566-acf1-38a0bb4e5d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:19 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] Volume volume-c0b8be57-2acf-418a-b061-80c181a33dc7 (c0b8be57-2acf-418a-b061-80c181a33dc7): created successfully Apr 25 15:54:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (779a042f-6148-4566-acf1-38a0bb4e5d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] Flow 'volume_create_manager' (4eb9070a-b972-48e6-85b1-5cdd09f12012) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:54:19 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-f118989e-e2c1-4ef5-8786-9888de2fc9b1 tempest-CreateVolumesFromImageTest-593189135 None] Created volume successfully. Apr 25 15:54:19 devstack sudo[88428]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e24b04ab-0429-4117-9ce7-c4d884828b26 tempest-GroupsV314Test-1329876139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.432s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:19 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-e24b04ab-0429-4117-9ce7-c4d884828b26 tempest-GroupsV314Test-1329876139 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:54:19 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-e24b04ab-0429-4117-9ce7-c4d884828b26 tempest-GroupsV314Test-1329876139 None] Delete group completed successfully. Apr 25 15:54:19 devstack sudo[88430]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1fa20e8a-069d-4e52-b5bd-ed76e33d4890 1073741824" returned: 0 in 0.647s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1fa20e8a-069d-4e52-b5bd-ed76e33d4890 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:19 devstack sudo[88436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1fa20e8a-069d-4e52-b5bd-ed76e33d4890 Apr 25 15:54:19 devstack sudo[88436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:20 devstack sudo[88436]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1fa20e8a-069d-4e52-b5bd-ed76e33d4890" returned: 0 in 0.470s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:20 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:54:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.715s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:20 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:54:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-340458934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faef3e28-6c12-4c7b-9761-761fec9c507b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e0eb07f991e4714b93869fad6090270',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:54:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:54:16Z,use_quota=True,user_id='3934e6d681834012a06834163d63ee13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:54:20 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] Creating volume faef3e28-6c12-4c7b-9761-761fec9c507b {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:54:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:20 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:54:20 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:54:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:20 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:54:20 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:54:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-faef3e28-6c12-4c7b-9761-761fec9c507b 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:20 devstack sudo[88439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-faef3e28-6c12-4c7b-9761-761fec9c507b 1073741824 Apr 25 15:54:20 devstack sudo[88439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d926b5bb-d143-490c-9db3-d2d494850500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fa20e8a-069d-4e52-b5bd-ed76e33d4890', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af568c0-e785-476d-9583-7feb62194e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:20 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] Volume volume-1fa20e8a-069d-4e52-b5bd-ed76e33d4890 (1fa20e8a-069d-4e52-b5bd-ed76e33d4890): created successfully Apr 25 15:54:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af568c0-e785-476d-9583-7feb62194e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] Flow 'volume_create_manager' (f6dd55b7-5334-4089-ae19-04d88be266d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:54:20 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-fe506643-ef90-40f6-a45f-adf3bb8ef7db tempest-CreateVolumesFromImageTest-593189135 None] Created volume successfully. Apr 25 15:54:20 devstack sudo[88439]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-faef3e28-6c12-4c7b-9761-761fec9c507b 1073741824" returned: 0 in 0.696s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-faef3e28-6c12-4c7b-9761-761fec9c507b {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:20 devstack sudo[88444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-faef3e28-6c12-4c7b-9761-761fec9c507b Apr 25 15:54:20 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:21 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-faef3e28-6c12-4c7b-9761-761fec9c507b" returned: 0 in 0.482s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:21 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:54:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:21 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08ed46b-afe6-49fa-982a-6b4bece038b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faef3e28-6c12-4c7b-9761-761fec9c507b', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:21 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a1d6a64-8211-4827-95a2-ce1ea75f487d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:21 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] Volume volume-faef3e28-6c12-4c7b-9761-761fec9c507b (faef3e28-6c12-4c7b-9761-761fec9c507b): created successfully Apr 25 15:54:21 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a1d6a64-8211-4827-95a2-ce1ea75f487d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:21 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] Flow 'volume_create_manager' (e6284088-446f-40c6-8c18-b00f33d4f5cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:54:21 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-c703c9de-e224-459a-8b77-c6d3cb278eb9 tempest-CreateVolumesFromImageTest-593189135 None] Created volume successfully. Apr 25 15:54:21 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f551399d-cce3-4e9d-bddf-33af23243713 tempest-CreateVolumesFromImageTest-593189135 None] Acquiring lock "cinder-faef3e28-6c12-4c7b-9761-761fec9c507b-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:21 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f551399d-cce3-4e9d-bddf-33af23243713 tempest-CreateVolumesFromImageTest-593189135 None] Lock "cinder-faef3e28-6c12-4c7b-9761-761fec9c507b-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:21 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f551399d-cce3-4e9d-bddf-33af23243713 tempest-CreateVolumesFromImageTest-593189135 None] Acquiring lock "cinder-quobyte-faef3e28-6c12-4c7b-9761-761fec9c507b" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:21 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f551399d-cce3-4e9d-bddf-33af23243713 tempest-CreateVolumesFromImageTest-593189135 None] Lock "cinder-quobyte-faef3e28-6c12-4c7b-9761-761fec9c507b" acquired by "delete_volume" :: waited 0.013s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:22 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ad987e-658f-42c6-a248-bd3a267534b0]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:54:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f551399d-cce3-4e9d-bddf-33af23243713 tempest-CreateVolumesFromImageTest-593189135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-faef3e28-6c12-4c7b-9761-761fec9c507b {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:22 devstack sudo[88448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-faef3e28-6c12-4c7b-9761-761fec9c507b Apr 25 15:54:22 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:22 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f551399d-cce3-4e9d-bddf-33af23243713 tempest-CreateVolumesFromImageTest-593189135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-faef3e28-6c12-4c7b-9761-761fec9c507b" returned: 0 in 0.593s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f551399d-cce3-4e9d-bddf-33af23243713 tempest-CreateVolumesFromImageTest-593189135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-faef3e28-6c12-4c7b-9761-761fec9c507b {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:22 devstack sudo[88453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-faef3e28-6c12-4c7b-9761-761fec9c507b Apr 25 15:54:22 devstack sudo[88453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:23 devstack sudo[88453]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f551399d-cce3-4e9d-bddf-33af23243713 tempest-CreateVolumesFromImageTest-593189135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-faef3e28-6c12-4c7b-9761-761fec9c507b" returned: 0 in 0.490s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:23 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f551399d-cce3-4e9d-bddf-33af23243713 tempest-CreateVolumesFromImageTest-593189135 None] Lock "cinder-quobyte-faef3e28-6c12-4c7b-9761-761fec9c507b" released by "delete_volume" :: held 1.123s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:23 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-f551399d-cce3-4e9d-bddf-33af23243713 tempest-CreateVolumesFromImageTest-593189135 None] Created reservations ['c63258ea-546a-4565-8efd-15688083e65e', '81f8d4ec-8711-4535-9a6b-6b804d9a4dc4', '46e52447-8349-4efa-98f3-69f253ac6caf', '97b97cf1-53e9-4831-89da-54bc459818a3'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:54:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f551399d-cce3-4e9d-bddf-33af23243713 tempest-CreateVolumesFromImageTest-593189135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f551399d-cce3-4e9d-bddf-33af23243713 tempest-CreateVolumesFromImageTest-593189135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:23 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f551399d-cce3-4e9d-bddf-33af23243713 tempest-CreateVolumesFromImageTest-593189135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:54:23 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f551399d-cce3-4e9d-bddf-33af23243713 tempest-CreateVolumesFromImageTest-593189135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:54:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f551399d-cce3-4e9d-bddf-33af23243713 tempest-CreateVolumesFromImageTest-593189135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f551399d-cce3-4e9d-bddf-33af23243713 tempest-CreateVolumesFromImageTest-593189135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:23 devstack sudo[88456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:54:23 devstack sudo[88456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:23 devstack sudo[88456]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f551399d-cce3-4e9d-bddf-33af23243713 tempest-CreateVolumesFromImageTest-593189135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.467s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:23 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-f551399d-cce3-4e9d-bddf-33af23243713 tempest-CreateVolumesFromImageTest-593189135 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:54:23 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-f551399d-cce3-4e9d-bddf-33af23243713 tempest-CreateVolumesFromImageTest-593189135 None] Deleted volume successfully. Apr 25 15:54:23 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f551399d-cce3-4e9d-bddf-33af23243713 tempest-CreateVolumesFromImageTest-593189135 None] Lock "cinder-faef3e28-6c12-4c7b-9761-761fec9c507b-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:24 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7676c724-5686-4527-8fcd-fcbbde985bcd tempest-CreateVolumesFromImageTest-593189135 None] Acquiring lock "cinder-1fa20e8a-069d-4e52-b5bd-ed76e33d4890-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:24 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7676c724-5686-4527-8fcd-fcbbde985bcd tempest-CreateVolumesFromImageTest-593189135 None] Lock "cinder-1fa20e8a-069d-4e52-b5bd-ed76e33d4890-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:24 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7676c724-5686-4527-8fcd-fcbbde985bcd tempest-CreateVolumesFromImageTest-593189135 None] Acquiring lock "cinder-quobyte-1fa20e8a-069d-4e52-b5bd-ed76e33d4890" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:24 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7676c724-5686-4527-8fcd-fcbbde985bcd tempest-CreateVolumesFromImageTest-593189135 None] Lock "cinder-quobyte-1fa20e8a-069d-4e52-b5bd-ed76e33d4890" acquired by "delete_volume" :: waited 0.015s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:24 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f7f42a-8a7e-48ba-8f8b-631dacf1abf2]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:54:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7676c724-5686-4527-8fcd-fcbbde985bcd tempest-CreateVolumesFromImageTest-593189135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1fa20e8a-069d-4e52-b5bd-ed76e33d4890 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:24 devstack sudo[88459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1fa20e8a-069d-4e52-b5bd-ed76e33d4890 Apr 25 15:54:24 devstack sudo[88459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:24 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:54:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Flow 'volume_create_manager' (911a324d-ea2d-4f52-b503-d66fd4c3b284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:54:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35ae4c98-c3df-4d00-8bca-1d2fc0962479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35ae4c98-c3df-4d00-8bca-1d2fc0962479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-233557238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d32a6372-2b00-4f30-986a-aabc42895936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9351d603d5f4a39be3a5cd5ae034c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:54:24Z,use_quota=True,user_id='0a19bb2530e647f18b1f90d64519acf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a56faa97-e7d4-4f71-b027-6ce1b53732f4),volume_type_id=a56faa97-e7d4-4f71-b027-6ce1b53732f4)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff892772-ef88-4404-b322-b9f7806c636b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff892772-ef88-4404-b322-b9f7806c636b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d4b4706-7848-4a7f-a3df-59323c1fd7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d4b4706-7848-4a7f-a3df-59323c1fd7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd32a6372-2b00-4f30-986a-aabc42895936', 'volume_name': 'volume-d32a6372-2b00-4f30-986a-aabc42895936', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd8edcde-8b9b-474b-8770-f9a1c8dcaced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd8edcde-8b9b-474b-8770-f9a1c8dcaced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8288a0c6-404d-434b-845b-cf5f81e0ad36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:24 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Volume d32a6372-2b00-4f30-986a-aabc42895936: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d32a6372-2b00-4f30-986a-aabc42895936', 'volume_size': 1} Apr 25 15:54:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:24 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-233557238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d32a6372-2b00-4f30-986a-aabc42895936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9351d603d5f4a39be3a5cd5ae034c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:54:24Z,use_quota=True,user_id='0a19bb2530e647f18b1f90d64519acf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a56faa97-e7d4-4f71-b027-6ce1b53732f4),volume_type_id=a56faa97-e7d4-4f71-b027-6ce1b53732f4)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:54:24 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Creating volume d32a6372-2b00-4f30-986a-aabc42895936 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:54:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:24 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:54:24 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:54:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:24 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:54:24 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:54:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d32a6372-2b00-4f30-986a-aabc42895936 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:24 devstack sudo[88461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d32a6372-2b00-4f30-986a-aabc42895936 1073741824 Apr 25 15:54:24 devstack sudo[88461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:24 devstack sudo[88459]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7676c724-5686-4527-8fcd-fcbbde985bcd tempest-CreateVolumesFromImageTest-593189135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1fa20e8a-069d-4e52-b5bd-ed76e33d4890" returned: 0 in 0.548s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7676c724-5686-4527-8fcd-fcbbde985bcd tempest-CreateVolumesFromImageTest-593189135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1fa20e8a-069d-4e52-b5bd-ed76e33d4890 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:24 devstack sudo[88466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1fa20e8a-069d-4e52-b5bd-ed76e33d4890 Apr 25 15:54:24 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:25 devstack sudo[88461]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d32a6372-2b00-4f30-986a-aabc42895936 1073741824" returned: 0 in 0.589s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d32a6372-2b00-4f30-986a-aabc42895936 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:25 devstack sudo[88471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d32a6372-2b00-4f30-986a-aabc42895936 Apr 25 15:54:25 devstack sudo[88471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:25 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7676c724-5686-4527-8fcd-fcbbde985bcd tempest-CreateVolumesFromImageTest-593189135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1fa20e8a-069d-4e52-b5bd-ed76e33d4890" returned: 0 in 0.513s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:25 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7676c724-5686-4527-8fcd-fcbbde985bcd tempest-CreateVolumesFromImageTest-593189135 None] Lock "cinder-quobyte-1fa20e8a-069d-4e52-b5bd-ed76e33d4890" released by "delete_volume" :: held 1.104s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:25 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-7676c724-5686-4527-8fcd-fcbbde985bcd tempest-CreateVolumesFromImageTest-593189135 None] Created reservations ['5ea4a753-52cf-41a1-919c-7661a4b9c5dc', '8e447cfd-0e7d-4dcd-9e2b-9caec6551766', 'c904e9e1-8e93-4618-bef5-0a7496fdd847', '4681a7a7-dd0d-42e7-a619-96bcf45d2c68'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:54:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7676c724-5686-4527-8fcd-fcbbde985bcd tempest-CreateVolumesFromImageTest-593189135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7676c724-5686-4527-8fcd-fcbbde985bcd tempest-CreateVolumesFromImageTest-593189135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:25 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-7676c724-5686-4527-8fcd-fcbbde985bcd tempest-CreateVolumesFromImageTest-593189135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:54:25 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-7676c724-5686-4527-8fcd-fcbbde985bcd tempest-CreateVolumesFromImageTest-593189135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:54:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7676c724-5686-4527-8fcd-fcbbde985bcd tempest-CreateVolumesFromImageTest-593189135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7676c724-5686-4527-8fcd-fcbbde985bcd tempest-CreateVolumesFromImageTest-593189135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:25 devstack sudo[88474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:54:25 devstack sudo[88474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:25 devstack sudo[88471]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d32a6372-2b00-4f30-986a-aabc42895936" returned: 0 in 0.489s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:25 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:54:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8288a0c6-404d-434b-845b-cf5f81e0ad36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d32a6372-2b00-4f30-986a-aabc42895936', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (082e7192-1a2a-44ce-a09e-7936704d4400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:25 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Volume volume-d32a6372-2b00-4f30-986a-aabc42895936 (d32a6372-2b00-4f30-986a-aabc42895936): created successfully Apr 25 15:54:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (082e7192-1a2a-44ce-a09e-7936704d4400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Flow 'volume_create_manager' (911a324d-ea2d-4f52-b503-d66fd4c3b284) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:54:25 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-77038311-51a3-4df4-a6bb-80eee87f3935 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Created volume successfully. Apr 25 15:54:25 devstack sudo[88474]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7676c724-5686-4527-8fcd-fcbbde985bcd tempest-CreateVolumesFromImageTest-593189135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.440s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:25 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-7676c724-5686-4527-8fcd-fcbbde985bcd tempest-CreateVolumesFromImageTest-593189135 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:54:25 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-7676c724-5686-4527-8fcd-fcbbde985bcd tempest-CreateVolumesFromImageTest-593189135 None] Deleted volume successfully. Apr 25 15:54:25 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7676c724-5686-4527-8fcd-fcbbde985bcd tempest-CreateVolumesFromImageTest-593189135 None] Lock "cinder-1fa20e8a-069d-4e52-b5bd-ed76e33d4890-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:26 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-2d6467b9-9759-409b-b6d3-f736d9534a04 tempest-CreateVolumesFromImageTest-593189135 None] Acquiring lock "cinder-c0b8be57-2acf-418a-b061-80c181a33dc7-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:26 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-2d6467b9-9759-409b-b6d3-f736d9534a04 tempest-CreateVolumesFromImageTest-593189135 None] Lock "cinder-c0b8be57-2acf-418a-b061-80c181a33dc7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:26 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-2d6467b9-9759-409b-b6d3-f736d9534a04 tempest-CreateVolumesFromImageTest-593189135 None] Acquiring lock "cinder-quobyte-c0b8be57-2acf-418a-b061-80c181a33dc7" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:26 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-2d6467b9-9759-409b-b6d3-f736d9534a04 tempest-CreateVolumesFromImageTest-593189135 None] Lock "cinder-quobyte-c0b8be57-2acf-418a-b061-80c181a33dc7" acquired by "delete_volume" :: waited 0.018s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:26 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7435c3-f1c1-4873-a9af-a39b23cb6130]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:54:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2d6467b9-9759-409b-b6d3-f736d9534a04 tempest-CreateVolumesFromImageTest-593189135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c0b8be57-2acf-418a-b061-80c181a33dc7 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:26 devstack sudo[88478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c0b8be57-2acf-418a-b061-80c181a33dc7 Apr 25 15:54:26 devstack sudo[88478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0d9737df-ffb5-470a-b6d2-a0a9cb7014c1 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0d9737df-ffb5-470a-b6d2-a0a9cb7014c1 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:26 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-0d9737df-ffb5-470a-b6d2-a0a9cb7014c1 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:54:26 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-0d9737df-ffb5-470a-b6d2-a0a9cb7014c1 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:54:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0d9737df-ffb5-470a-b6d2-a0a9cb7014c1 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0d9737df-ffb5-470a-b6d2-a0a9cb7014c1 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:26 devstack sudo[88483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:54:26 devstack sudo[88483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:27 devstack sudo[88478]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2d6467b9-9759-409b-b6d3-f736d9534a04 tempest-CreateVolumesFromImageTest-593189135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c0b8be57-2acf-418a-b061-80c181a33dc7" returned: 0 in 0.566s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2d6467b9-9759-409b-b6d3-f736d9534a04 tempest-CreateVolumesFromImageTest-593189135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c0b8be57-2acf-418a-b061-80c181a33dc7 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:27 devstack sudo[88485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c0b8be57-2acf-418a-b061-80c181a33dc7 Apr 25 15:54:27 devstack sudo[88485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:27 devstack sudo[88483]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0d9737df-ffb5-470a-b6d2-a0a9cb7014c1 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.451s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:27 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-0d9737df-ffb5-470a-b6d2-a0a9cb7014c1 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:54:27 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-0d9737df-ffb5-470a-b6d2-a0a9cb7014c1 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Retype volume completed successfully. Apr 25 15:54:27 devstack sudo[88485]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2d6467b9-9759-409b-b6d3-f736d9534a04 tempest-CreateVolumesFromImageTest-593189135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c0b8be57-2acf-418a-b061-80c181a33dc7" returned: 0 in 0.438s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:27 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-2d6467b9-9759-409b-b6d3-f736d9534a04 tempest-CreateVolumesFromImageTest-593189135 None] Lock "cinder-quobyte-c0b8be57-2acf-418a-b061-80c181a33dc7" released by "delete_volume" :: held 1.042s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:27 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-2d6467b9-9759-409b-b6d3-f736d9534a04 tempest-CreateVolumesFromImageTest-593189135 None] Created reservations ['1a125808-9680-4207-ac9f-488228ba65c1', '632027c7-467a-4f3b-b987-b915ceed04c9', '9e7917f5-8696-4ed3-92b3-0381358cfa2f', 'c47f6edb-3ff8-43ae-935e-8636b4679b81'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:54:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-2d6467b9-9759-409b-b6d3-f736d9534a04 tempest-CreateVolumesFromImageTest-593189135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-2d6467b9-9759-409b-b6d3-f736d9534a04 tempest-CreateVolumesFromImageTest-593189135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:27 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-2d6467b9-9759-409b-b6d3-f736d9534a04 tempest-CreateVolumesFromImageTest-593189135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:54:27 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-2d6467b9-9759-409b-b6d3-f736d9534a04 tempest-CreateVolumesFromImageTest-593189135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:54:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-2d6467b9-9759-409b-b6d3-f736d9534a04 tempest-CreateVolumesFromImageTest-593189135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2d6467b9-9759-409b-b6d3-f736d9534a04 tempest-CreateVolumesFromImageTest-593189135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:27 devstack sudo[88489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:54:27 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:28 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2d6467b9-9759-409b-b6d3-f736d9534a04 tempest-CreateVolumesFromImageTest-593189135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.480s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:28 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-2d6467b9-9759-409b-b6d3-f736d9534a04 tempest-CreateVolumesFromImageTest-593189135 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:54:28 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-2d6467b9-9759-409b-b6d3-f736d9534a04 tempest-CreateVolumesFromImageTest-593189135 None] Deleted volume successfully. Apr 25 15:54:28 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-2d6467b9-9759-409b-b6d3-f736d9534a04 tempest-CreateVolumesFromImageTest-593189135 None] Lock "cinder-c0b8be57-2acf-418a-b061-80c181a33dc7-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:28 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-0f0febaf-c85b-476c-b5c4-d92497108f81 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Acquiring lock "cinder-d32a6372-2b00-4f30-986a-aabc42895936-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:28 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-0f0febaf-c85b-476c-b5c4-d92497108f81 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Lock "cinder-d32a6372-2b00-4f30-986a-aabc42895936-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:28 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-0f0febaf-c85b-476c-b5c4-d92497108f81 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Acquiring lock "cinder-quobyte-d32a6372-2b00-4f30-986a-aabc42895936" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:28 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-0f0febaf-c85b-476c-b5c4-d92497108f81 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Lock "cinder-quobyte-d32a6372-2b00-4f30-986a-aabc42895936" acquired by "delete_volume" :: waited 0.020s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:28 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee0d503-14dd-44e6-93cd-9b5cd9c87019]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:54:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0f0febaf-c85b-476c-b5c4-d92497108f81 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d32a6372-2b00-4f30-986a-aabc42895936 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:28 devstack sudo[88492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d32a6372-2b00-4f30-986a-aabc42895936 Apr 25 15:54:28 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:28 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9e4dfbb0-4e53-4ab3-b47a-efddb25f2eca tempest-CreateVolumesFromImageTest-593189135 None] Acquiring lock "cinder-6f015ad0-be6c-4877-8425-f8d8f4c58e9a-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:28 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9e4dfbb0-4e53-4ab3-b47a-efddb25f2eca tempest-CreateVolumesFromImageTest-593189135 None] Lock "cinder-6f015ad0-be6c-4877-8425-f8d8f4c58e9a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:28 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9e4dfbb0-4e53-4ab3-b47a-efddb25f2eca tempest-CreateVolumesFromImageTest-593189135 None] Acquiring lock "cinder-quobyte-6f015ad0-be6c-4877-8425-f8d8f4c58e9a" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:28 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9e4dfbb0-4e53-4ab3-b47a-efddb25f2eca tempest-CreateVolumesFromImageTest-593189135 None] Lock "cinder-quobyte-6f015ad0-be6c-4877-8425-f8d8f4c58e9a" acquired by "delete_volume" :: waited 0.019s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:28 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[2977e6ab-c8ff-4a9f-afc0-af592a8e4147]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:54:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9e4dfbb0-4e53-4ab3-b47a-efddb25f2eca tempest-CreateVolumesFromImageTest-593189135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6f015ad0-be6c-4877-8425-f8d8f4c58e9a {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:28 devstack sudo[88495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6f015ad0-be6c-4877-8425-f8d8f4c58e9a Apr 25 15:54:28 devstack sudo[88495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:28 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0f0febaf-c85b-476c-b5c4-d92497108f81 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d32a6372-2b00-4f30-986a-aabc42895936" returned: 0 in 0.585s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0f0febaf-c85b-476c-b5c4-d92497108f81 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d32a6372-2b00-4f30-986a-aabc42895936 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:28 devstack sudo[88500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d32a6372-2b00-4f30-986a-aabc42895936 Apr 25 15:54:28 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:29 devstack sudo[88495]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9e4dfbb0-4e53-4ab3-b47a-efddb25f2eca tempest-CreateVolumesFromImageTest-593189135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6f015ad0-be6c-4877-8425-f8d8f4c58e9a" returned: 0 in 0.545s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9e4dfbb0-4e53-4ab3-b47a-efddb25f2eca tempest-CreateVolumesFromImageTest-593189135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6f015ad0-be6c-4877-8425-f8d8f4c58e9a {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:29 devstack sudo[88506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6f015ad0-be6c-4877-8425-f8d8f4c58e9a Apr 25 15:54:29 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:29 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0f0febaf-c85b-476c-b5c4-d92497108f81 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d32a6372-2b00-4f30-986a-aabc42895936" returned: 0 in 0.454s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:29 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-0f0febaf-c85b-476c-b5c4-d92497108f81 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Lock "cinder-quobyte-d32a6372-2b00-4f30-986a-aabc42895936" released by "delete_volume" :: held 1.087s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:29 devstack cinder-volume[81828]: WARNING cinder.quota [None req-0f0febaf-c85b-476c-b5c4-d92497108f81 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 25 15:54:29 devstack cinder-volume[81828]: WARNING cinder.quota [None req-0f0febaf-c85b-476c-b5c4-d92497108f81 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 25 15:54:29 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-0f0febaf-c85b-476c-b5c4-d92497108f81 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Created reservations ['dcb34ac8-ec7e-4160-ab7f-1f2e0bb7fe7d', '8f203512-a14c-419d-95e2-7175d361d18d', 'fa1fbcb7-c40f-495b-bc36-2c1c45b3df8c', 'b1b30550-f9c5-4f5c-91ad-512bcd22eb7f'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:54:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0f0febaf-c85b-476c-b5c4-d92497108f81 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0f0febaf-c85b-476c-b5c4-d92497108f81 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:29 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-0f0febaf-c85b-476c-b5c4-d92497108f81 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:54:29 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-0f0febaf-c85b-476c-b5c4-d92497108f81 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:54:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0f0febaf-c85b-476c-b5c4-d92497108f81 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0f0febaf-c85b-476c-b5c4-d92497108f81 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:29 devstack sudo[88508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:54:29 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:29 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9e4dfbb0-4e53-4ab3-b47a-efddb25f2eca tempest-CreateVolumesFromImageTest-593189135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6f015ad0-be6c-4877-8425-f8d8f4c58e9a" returned: 0 in 0.446s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:29 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9e4dfbb0-4e53-4ab3-b47a-efddb25f2eca tempest-CreateVolumesFromImageTest-593189135 None] Lock "cinder-quobyte-6f015ad0-be6c-4877-8425-f8d8f4c58e9a" released by "delete_volume" :: held 1.033s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:29 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-9e4dfbb0-4e53-4ab3-b47a-efddb25f2eca tempest-CreateVolumesFromImageTest-593189135 None] Created reservations ['2d3e62b1-cc98-4d1b-af47-94588c83f7b9', '80da9109-818f-46e8-8c8b-88a40789bae3', 'cf778024-a0da-4886-ba40-6dd32fb24c5f', '111636d0-fb90-40b2-b1d9-98aaec6e8a0a'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:54:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9e4dfbb0-4e53-4ab3-b47a-efddb25f2eca tempest-CreateVolumesFromImageTest-593189135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9e4dfbb0-4e53-4ab3-b47a-efddb25f2eca tempest-CreateVolumesFromImageTest-593189135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:29 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-9e4dfbb0-4e53-4ab3-b47a-efddb25f2eca tempest-CreateVolumesFromImageTest-593189135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:54:29 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-9e4dfbb0-4e53-4ab3-b47a-efddb25f2eca tempest-CreateVolumesFromImageTest-593189135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:54:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9e4dfbb0-4e53-4ab3-b47a-efddb25f2eca tempest-CreateVolumesFromImageTest-593189135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9e4dfbb0-4e53-4ab3-b47a-efddb25f2eca tempest-CreateVolumesFromImageTest-593189135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:29 devstack sudo[88512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:54:29 devstack sudo[88512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:29 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0f0febaf-c85b-476c-b5c4-d92497108f81 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.476s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:29 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-0f0febaf-c85b-476c-b5c4-d92497108f81 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:54:29 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-0f0febaf-c85b-476c-b5c4-d92497108f81 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Deleted volume successfully. Apr 25 15:54:29 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-0f0febaf-c85b-476c-b5c4-d92497108f81 tempest-VolumeRetypeWithoutMigrationTest-1792021199 None] Lock "cinder-d32a6372-2b00-4f30-986a-aabc42895936-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:30 devstack sudo[88512]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9e4dfbb0-4e53-4ab3-b47a-efddb25f2eca tempest-CreateVolumesFromImageTest-593189135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.442s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:30 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-9e4dfbb0-4e53-4ab3-b47a-efddb25f2eca tempest-CreateVolumesFromImageTest-593189135 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:54:30 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-9e4dfbb0-4e53-4ab3-b47a-efddb25f2eca tempest-CreateVolumesFromImageTest-593189135 None] Deleted volume successfully. Apr 25 15:54:30 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9e4dfbb0-4e53-4ab3-b47a-efddb25f2eca tempest-CreateVolumesFromImageTest-593189135 None] Lock "cinder-6f015ad0-be6c-4877-8425-f8d8f4c58e9a-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:30 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c52276b5-93f9-46d9-88fc-5d471631a70e tempest-CreateVolumesFromImageTest-593189135 None] Acquiring lock "cinder-a21d7ce0-899f-45f1-a72d-347d846408dc-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:30 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c52276b5-93f9-46d9-88fc-5d471631a70e tempest-CreateVolumesFromImageTest-593189135 None] Lock "cinder-a21d7ce0-899f-45f1-a72d-347d846408dc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:30 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c52276b5-93f9-46d9-88fc-5d471631a70e tempest-CreateVolumesFromImageTest-593189135 None] Acquiring lock "cinder-quobyte-a21d7ce0-899f-45f1-a72d-347d846408dc" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:30 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c52276b5-93f9-46d9-88fc-5d471631a70e tempest-CreateVolumesFromImageTest-593189135 None] Lock "cinder-quobyte-a21d7ce0-899f-45f1-a72d-347d846408dc" acquired by "delete_volume" :: waited 0.024s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:30 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[192c602e-7f8e-41b5-ab13-1449ee6143f4]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:54:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c52276b5-93f9-46d9-88fc-5d471631a70e tempest-CreateVolumesFromImageTest-593189135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a21d7ce0-899f-45f1-a72d-347d846408dc {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:31 devstack sudo[88515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a21d7ce0-899f-45f1-a72d-347d846408dc Apr 25 15:54:31 devstack sudo[88515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:31 devstack sudo[88515]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c52276b5-93f9-46d9-88fc-5d471631a70e tempest-CreateVolumesFromImageTest-593189135 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a21d7ce0-899f-45f1-a72d-347d846408dc" returned: 0 in 0.554s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c52276b5-93f9-46d9-88fc-5d471631a70e tempest-CreateVolumesFromImageTest-593189135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a21d7ce0-899f-45f1-a72d-347d846408dc {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:31 devstack sudo[88521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a21d7ce0-899f-45f1-a72d-347d846408dc Apr 25 15:54:31 devstack sudo[88521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:31 devstack sudo[88521]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c52276b5-93f9-46d9-88fc-5d471631a70e tempest-CreateVolumesFromImageTest-593189135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a21d7ce0-899f-45f1-a72d-347d846408dc" returned: 0 in 0.517s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:32 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c52276b5-93f9-46d9-88fc-5d471631a70e tempest-CreateVolumesFromImageTest-593189135 None] Lock "cinder-quobyte-a21d7ce0-899f-45f1-a72d-347d846408dc" released by "delete_volume" :: held 1.115s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:32 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-c52276b5-93f9-46d9-88fc-5d471631a70e tempest-CreateVolumesFromImageTest-593189135 None] Created reservations ['3f09d2a9-544a-40e3-96ac-aaa20102eda2', '67c11bd2-1474-4e29-831b-31b704adc0bd', '7a8b7072-38d6-45be-8d06-8b6cbc6b6b39', '46821ae9-6d36-4b85-ab9d-f5a2ab5fc93b'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:54:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c52276b5-93f9-46d9-88fc-5d471631a70e tempest-CreateVolumesFromImageTest-593189135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c52276b5-93f9-46d9-88fc-5d471631a70e tempest-CreateVolumesFromImageTest-593189135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:32 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c52276b5-93f9-46d9-88fc-5d471631a70e tempest-CreateVolumesFromImageTest-593189135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:54:32 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c52276b5-93f9-46d9-88fc-5d471631a70e tempest-CreateVolumesFromImageTest-593189135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:54:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c52276b5-93f9-46d9-88fc-5d471631a70e tempest-CreateVolumesFromImageTest-593189135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c52276b5-93f9-46d9-88fc-5d471631a70e tempest-CreateVolumesFromImageTest-593189135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:32 devstack sudo[88524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:54:32 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:32 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c52276b5-93f9-46d9-88fc-5d471631a70e tempest-CreateVolumesFromImageTest-593189135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.526s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:32 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-c52276b5-93f9-46d9-88fc-5d471631a70e tempest-CreateVolumesFromImageTest-593189135 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:54:32 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-c52276b5-93f9-46d9-88fc-5d471631a70e tempest-CreateVolumesFromImageTest-593189135 None] Deleted volume successfully. Apr 25 15:54:32 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c52276b5-93f9-46d9-88fc-5d471631a70e tempest-CreateVolumesFromImageTest-593189135 None] Lock "cinder-a21d7ce0-899f-45f1-a72d-347d846408dc-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:35 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:54:35 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Flow 'volume_create_manager' (fcb818c2-4c9f-48fc-bf41-531f4e0af3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:54:35 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87c71018-13d6-4b5c-ae9b-3024f73d2f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:35 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87c71018-13d6-4b5c-ae9b-3024f73d2f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1411520037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=105ba519-0bc8-49bd-99f8-5016a9f69998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b1d09257ff0472d8d6dcbba5be5ec3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:54:36Z,use_quota=True,user_id='ad96c1171e334a57802ec21c3a6563f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:35 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8ea647a-89c5-4f3b-945b-d079211bc195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:35 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8ea647a-89c5-4f3b-945b-d079211bc195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:35 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b069abbd-2f52-4b98-a16d-8cab7205c75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:35 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b069abbd-2f52-4b98-a16d-8cab7205c75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '105ba519-0bc8-49bd-99f8-5016a9f69998', 'volume_name': 'volume-105ba519-0bc8-49bd-99f8-5016a9f69998', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:35 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e8d9ace-a202-4aef-9e93-e19454f7c9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:35 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e8d9ace-a202-4aef-9e93-e19454f7c9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:35 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b9b810-38d7-4792-9f6b-7c71436ace0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:35 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Volume 105ba519-0bc8-49bd-99f8-5016a9f69998: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-105ba519-0bc8-49bd-99f8-5016a9f69998', 'volume_size': 1} Apr 25 15:54:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:35 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1411520037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=105ba519-0bc8-49bd-99f8-5016a9f69998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b1d09257ff0472d8d6dcbba5be5ec3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:54:36Z,use_quota=True,user_id='ad96c1171e334a57802ec21c3a6563f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:54:35 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Creating volume 105ba519-0bc8-49bd-99f8-5016a9f69998 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:54:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:35 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:54:35 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:54:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:35 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:54:35 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:54:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:35 devstack sudo[88527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998 1073741824 Apr 25 15:54:35 devstack sudo[88527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:36 devstack sudo[88527]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998 1073741824" returned: 0 in 0.637s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:36 devstack sudo[88532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998 Apr 25 15:54:36 devstack sudo[88532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:36 devstack sudo[88532]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998" returned: 0 in 0.506s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:36 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:54:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:36 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b9b810-38d7-4792-9f6b-7c71436ace0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-105ba519-0bc8-49bd-99f8-5016a9f69998', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:36 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a511ae1-a44a-4953-8fc4-189fc16c5fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:36 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Volume volume-105ba519-0bc8-49bd-99f8-5016a9f69998 (105ba519-0bc8-49bd-99f8-5016a9f69998): created successfully Apr 25 15:54:36 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a511ae1-a44a-4953-8fc4-189fc16c5fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:36 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Flow 'volume_create_manager' (fcb818c2-4c9f-48fc-bf41-531f4e0af3c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:54:36 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-d6535819-c2d3-4295-be3a-376ad0d18451 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Created volume successfully. Apr 25 15:54:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fdcc4b7c-2d66-4816-804b-fe066760255c tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fdcc4b7c-2d66-4816-804b-fe066760255c tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:37 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-fdcc4b7c-2d66-4816-804b-fe066760255c tempest-CreateVolumesFromSnapshotTest-2062994582 None] Creating offline snapshot cbea59de-da7e-44d0-86d3-d5b286aebb30 of volume 105ba519-0bc8-49bd-99f8-5016a9f69998 {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 15:54:38 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c11fde8-2646-4709-96af-3dcec2b16174]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:54:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fdcc4b7c-2d66-4816-804b-fe066760255c tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:38 devstack sudo[88537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998 Apr 25 15:54:38 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:38 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fdcc4b7c-2d66-4816-804b-fe066760255c tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998" returned: 0 in 0.533s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fdcc4b7c-2d66-4816-804b-fe066760255c tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998.cbea59de-da7e-44d0-86d3-d5b286aebb30 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:38 devstack sudo[88542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998.cbea59de-da7e-44d0-86d3-d5b286aebb30 1G Apr 25 15:54:38 devstack sudo[88542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:39 devstack sudo[88542]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fdcc4b7c-2d66-4816-804b-fe066760255c tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998.cbea59de-da7e-44d0-86d3-d5b286aebb30 1G" returned: 0 in 0.604s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fdcc4b7c-2d66-4816-804b-fe066760255c tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-105ba519-0bc8-49bd-99f8-5016a9f69998 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998.cbea59de-da7e-44d0-86d3-d5b286aebb30 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:39 devstack sudo[88547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-105ba519-0bc8-49bd-99f8-5016a9f69998 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998.cbea59de-da7e-44d0-86d3-d5b286aebb30 Apr 25 15:54:39 devstack sudo[88547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:39 devstack sudo[88547]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fdcc4b7c-2d66-4816-804b-fe066760255c tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-105ba519-0bc8-49bd-99f8-5016a9f69998 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998.cbea59de-da7e-44d0-86d3-d5b286aebb30" returned: 0 in 0.529s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:39 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-fdcc4b7c-2d66-4816-804b-fe066760255c tempest-CreateVolumesFromSnapshotTest-2062994582 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998.cbea59de-da7e-44d0-86d3-d5b286aebb30 is being set with open permissions: ugo+rw Apr 25 15:54:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fdcc4b7c-2d66-4816-804b-fe066760255c tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998.cbea59de-da7e-44d0-86d3-d5b286aebb30 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:39 devstack sudo[88552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998.cbea59de-da7e-44d0-86d3-d5b286aebb30 Apr 25 15:54:39 devstack sudo[88552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:40 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:54:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] Flow 'volume_create_manager' (68a68b3b-ba17-46aa-8561-debe7f47c80d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:54:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fda0d412-a9ec-457f-9c61-6f8c5366f2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:40 devstack sudo[88552]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fdcc4b7c-2d66-4816-804b-fe066760255c tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998.cbea59de-da7e-44d0-86d3-d5b286aebb30" returned: 0 in 0.480s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fda0d412-a9ec-457f-9c61-6f8c5366f2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1763781133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c48181-172f-44db-8adc-59b99cdb9555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40213dc4aa5e4f378e1bbb0d2dca9376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:54:40Z,use_quota=True,user_id='0f573884b63847fdada5bb12623ec2cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(defac4ce-54ee-448c-8480-17c77f6c5885),volume_type_id=defac4ce-54ee-448c-8480-17c77f6c5885)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (551ff837-6152-4921-a137-046e0a471a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (551ff837-6152-4921-a137-046e0a471a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b318cdda-ab5f-4978-a400-8cf0237d043b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b318cdda-ab5f-4978-a400-8cf0237d043b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21c48181-172f-44db-8adc-59b99cdb9555', 'volume_name': 'volume-21c48181-172f-44db-8adc-59b99cdb9555', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (355de84a-78b2-4a9a-95b1-985af60c196c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (355de84a-78b2-4a9a-95b1-985af60c196c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85cbaa0f-f9b4-4db1-9b1c-7044e4d6f22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:40 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] Volume 21c48181-172f-44db-8adc-59b99cdb9555: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21c48181-172f-44db-8adc-59b99cdb9555', 'volume_size': 1} Apr 25 15:54:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fdcc4b7c-2d66-4816-804b-fe066760255c tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:40 devstack sudo[88556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998.info Apr 25 15:54:40 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:40 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fdcc4b7c-2d66-4816-804b-fe066760255c tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998.info" returned: 0 in 0.456s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:40 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-fdcc4b7c-2d66-4816-804b-fe066760255c tempest-CreateVolumesFromSnapshotTest-2062994582 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998.info is being set with open permissions: ugo+rw Apr 25 15:54:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fdcc4b7c-2d66-4816-804b-fe066760255c tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:40 devstack sudo[88559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998.info Apr 25 15:54:40 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:41 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fdcc4b7c-2d66-4816-804b-fe066760255c tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998.info" returned: 0 in 0.440s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fdcc4b7c-2d66-4816-804b-fe066760255c tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.176s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.942s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:41 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:54:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1763781133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21c48181-172f-44db-8adc-59b99cdb9555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40213dc4aa5e4f378e1bbb0d2dca9376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:54:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:54:40Z,use_quota=True,user_id='0f573884b63847fdada5bb12623ec2cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(defac4ce-54ee-448c-8480-17c77f6c5885),volume_type_id=defac4ce-54ee-448c-8480-17c77f6c5885)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:54:41 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] Creating volume 21c48181-172f-44db-8adc-59b99cdb9555 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:54:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:41 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:54:41 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:54:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:41 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:54:41 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:54:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-21c48181-172f-44db-8adc-59b99cdb9555 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:41 devstack sudo[88562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-21c48181-172f-44db-8adc-59b99cdb9555 1073741824 Apr 25 15:54:41 devstack sudo[88562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:41 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-fdcc4b7c-2d66-4816-804b-fe066760255c tempest-CreateVolumesFromSnapshotTest-2062994582 None] Create snapshot completed successfully Apr 25 15:54:41 devstack sudo[88562]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-21c48181-172f-44db-8adc-59b99cdb9555 1073741824" returned: 0 in 0.606s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-21c48181-172f-44db-8adc-59b99cdb9555 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:41 devstack sudo[88568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-21c48181-172f-44db-8adc-59b99cdb9555 Apr 25 15:54:41 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:42 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-21c48181-172f-44db-8adc-59b99cdb9555" returned: 0 in 0.448s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85cbaa0f-f9b4-4db1-9b1c-7044e4d6f22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21c48181-172f-44db-8adc-59b99cdb9555', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (428dc48f-85ee-4aa8-8b29-c5ba0d55620d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:42 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] Volume volume-21c48181-172f-44db-8adc-59b99cdb9555 (21c48181-172f-44db-8adc-59b99cdb9555): created successfully Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (428dc48f-85ee-4aa8-8b29-c5ba0d55620d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] Flow 'volume_create_manager' (68a68b3b-ba17-46aa-8561-debe7f47c80d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:54:42 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-410fdfc1-e787-4d9e-b1f0-8eb6439e9b92 tempest-VolumeTypesAccessTest-61355348 None] Created volume successfully. Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] Flow 'volume_create_manager' (a09ac0fb-1ef4-45a7-bfc0-30fb56d74ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7466694-be44-4689-9b5f-35df587c3c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7466694-be44-4689-9b5f-35df587c3c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1741408535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b22f90fc-687e-4523-b7f8-9c97bfac94c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b1d09257ff0472d8d6dcbba5be5ec3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:54:42Z,use_quota=True,user_id='ad96c1171e334a57802ec21c3a6563f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1eca186-f461-4eb2-ab5d-12dbaa257add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1eca186-f461-4eb2-ab5d-12dbaa257add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f353ccb2-2e6d-40d6-9528-d13339fe68aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f353ccb2-2e6d-40d6-9528-d13339fe68aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b22f90fc-687e-4523-b7f8-9c97bfac94c6', 'volume_name': 'volume-b22f90fc-687e-4523-b7f8-9c97bfac94c6', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3442c37e-a9fa-42b4-9e5c-d9b584d10f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3442c37e-a9fa-42b4-9e5c-d9b584d10f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85923961-9a2c-4166-821e-f63569f8f7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:42 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] Volume b22f90fc-687e-4523-b7f8-9c97bfac94c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b22f90fc-687e-4523-b7f8-9c97bfac94c6', 'volume_size': 1} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1741408535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b22f90fc-687e-4523-b7f8-9c97bfac94c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b1d09257ff0472d8d6dcbba5be5ec3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:54:42Z,use_quota=True,user_id='ad96c1171e334a57802ec21c3a6563f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] Creating volume b22f90fc-687e-4523-b7f8-9c97bfac94c6 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:54:42 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b22f90fc-687e-4523-b7f8-9c97bfac94c6 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:42 devstack sudo[88571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b22f90fc-687e-4523-b7f8-9c97bfac94c6 1073741824 Apr 25 15:54:42 devstack sudo[88571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Flow 'volume_create_manager' (1bb9fdd4-a41f-4b36-bf20-7c0f696411fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (438c41bb-aaee-450b-9195-b21b079cc5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (438c41bb-aaee-450b-9195-b21b079cc5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-777391093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1007ee6c-9898-4800-b939-bb34f6f537e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b1d09257ff0472d8d6dcbba5be5ec3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:54:43Z,use_quota=True,user_id='ad96c1171e334a57802ec21c3a6563f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87249da4-327e-4eec-a30c-f95e0d10d2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87249da4-327e-4eec-a30c-f95e0d10d2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9528ca32-d0a9-4d0e-9338-182bceae7e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9528ca32-d0a9-4d0e-9338-182bceae7e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1007ee6c-9898-4800-b939-bb34f6f537e4', 'volume_name': 'volume-1007ee6c-9898-4800-b939-bb34f6f537e4', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c13612ce-1219-4b15-aacc-a04984a6d7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c13612ce-1219-4b15-aacc-a04984a6d7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3943440-3d77-4672-9c9d-52c4375ef4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:42 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Volume 1007ee6c-9898-4800-b939-bb34f6f537e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1007ee6c-9898-4800-b939-bb34f6f537e4', 'volume_size': 1} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:42 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Flow 'volume_create_manager' (e491fd64-2f2f-491c-aa25-f35583c8daf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88df6eda-2ac0-4cf0-8263-e06d00de1d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88df6eda-2ac0-4cf0-8263-e06d00de1d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2126115288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db3934b6-dd49-4e04-a6f4-4c2fa6d6571a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b1d09257ff0472d8d6dcbba5be5ec3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:54:43Z,use_quota=True,user_id='ad96c1171e334a57802ec21c3a6563f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d356ae16-de45-4316-9699-20bd59e08f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d356ae16-de45-4316-9699-20bd59e08f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36a7c798-2229-4a71-a496-7763edb5c0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36a7c798-2229-4a71-a496-7763edb5c0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db3934b6-dd49-4e04-a6f4-4c2fa6d6571a', 'volume_name': 'volume-db3934b6-dd49-4e04-a6f4-4c2fa6d6571a', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7e14517-aa57-46f9-a01f-f5631afa5e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7e14517-aa57-46f9-a01f-f5631afa5e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b13d8149-c013-440d-89fa-28e99e780239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:43 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Volume db3934b6-dd49-4e04-a6f4-4c2fa6d6571a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db3934b6-dd49-4e04-a6f4-4c2fa6d6571a', 'volume_size': 1} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:43 devstack sudo[88571]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b22f90fc-687e-4523-b7f8-9c97bfac94c6 1073741824" returned: 0 in 0.645s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b22f90fc-687e-4523-b7f8-9c97bfac94c6 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:43 devstack sudo[88576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b22f90fc-687e-4523-b7f8-9c97bfac94c6 Apr 25 15:54:43 devstack sudo[88576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Flow 'volume_create_manager' (f8514f69-1619-415e-91c1-312b0d45ce15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe2835d5-ef0a-4d9f-85d9-91ba728bde0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe2835d5-ef0a-4d9f-85d9-91ba728bde0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1014959997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14a90b6-9e98-4878-8bdf-e6eb1c89fc52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b1d09257ff0472d8d6dcbba5be5ec3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:54:43Z,use_quota=True,user_id='ad96c1171e334a57802ec21c3a6563f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d4d7f58-db24-45d9-8d16-1c1be0ff7338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d4d7f58-db24-45d9-8d16-1c1be0ff7338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f371552f-a3ec-412e-9755-88a3f08e0d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f371552f-a3ec-412e-9755-88a3f08e0d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f14a90b6-9e98-4878-8bdf-e6eb1c89fc52', 'volume_name': 'volume-f14a90b6-9e98-4878-8bdf-e6eb1c89fc52', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e1b30b-3d1e-491f-87f5-9988abf5d578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e1b30b-3d1e-491f-87f5-9988abf5d578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f858404b-9b21-4302-a85f-e173bdf6d7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:43 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Volume f14a90b6-9e98-4878-8bdf-e6eb1c89fc52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f14a90b6-9e98-4878-8bdf-e6eb1c89fc52', 'volume_size': 1} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9c352deb-b91e-4c76-9b07-38997a29f537 tempest-VolumeTypesAccessTest-61355348 None] Acquiring lock "cinder-21c48181-172f-44db-8adc-59b99cdb9555-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9c352deb-b91e-4c76-9b07-38997a29f537 tempest-VolumeTypesAccessTest-61355348 None] Lock "cinder-21c48181-172f-44db-8adc-59b99cdb9555-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9c352deb-b91e-4c76-9b07-38997a29f537 tempest-VolumeTypesAccessTest-61355348 None] Acquiring lock "cinder-quobyte-21c48181-172f-44db-8adc-59b99cdb9555" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9c352deb-b91e-4c76-9b07-38997a29f537 tempest-VolumeTypesAccessTest-61355348 None] Lock "cinder-quobyte-21c48181-172f-44db-8adc-59b99cdb9555" acquired by "delete_volume" :: waited 0.018s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Flow 'volume_create_manager' (6285b005-6d10-4592-8386-89ab4abfad93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0cb3051-0c38-41de-bef4-485fc7975367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[590e5299-5e71-46dd-a8d7-cdf820f57b38]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0cb3051-0c38-41de-bef4-485fc7975367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1580042531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=136a04d4-bc97-4f4c-9744-1317f97063ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b1d09257ff0472d8d6dcbba5be5ec3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:54:44Z,use_quota=True,user_id='ad96c1171e334a57802ec21c3a6563f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd81873-4e19-440a-b9ee-27d13313a892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fd81873-4e19-440a-b9ee-27d13313a892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4289fa2f-d661-4b51-b4cb-6dbbc09845e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4289fa2f-d661-4b51-b4cb-6dbbc09845e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '136a04d4-bc97-4f4c-9744-1317f97063ad', 'volume_name': 'volume-136a04d4-bc97-4f4c-9744-1317f97063ad', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d9645c1-e96d-4eca-a3fc-979fc70920f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d9645c1-e96d-4eca-a3fc-979fc70920f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b208eaf6-adf7-4bed-9cfe-89859f95f6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:43 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Volume 136a04d4-bc97-4f4c-9744-1317f97063ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-136a04d4-bc97-4f4c-9744-1317f97063ad', 'volume_size': 1} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9c352deb-b91e-4c76-9b07-38997a29f537 tempest-VolumeTypesAccessTest-61355348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-21c48181-172f-44db-8adc-59b99cdb9555 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:43 devstack sudo[88576]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b22f90fc-687e-4523-b7f8-9c97bfac94c6" returned: 0 in 0.538s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:43 devstack sudo[88581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-21c48181-172f-44db-8adc-59b99cdb9555 Apr 25 15:54:43 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.928s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-777391093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1007ee6c-9898-4800-b939-bb34f6f537e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b1d09257ff0472d8d6dcbba5be5ec3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:54:43Z,use_quota=True,user_id='ad96c1171e334a57802ec21c3a6563f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Creating volume 1007ee6c-9898-4800-b939-bb34f6f537e4 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:54:43 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1007ee6c-9898-4800-b939-bb34f6f537e4 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:43 devstack sudo[88583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1007ee6c-9898-4800-b939-bb34f6f537e4 1073741824 Apr 25 15:54:43 devstack sudo[88583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85923961-9a2c-4166-821e-f63569f8f7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b22f90fc-687e-4523-b7f8-9c97bfac94c6', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f6117ed-de6a-4024-87c4-a271d6013bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:43 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] Volume volume-b22f90fc-687e-4523-b7f8-9c97bfac94c6 (b22f90fc-687e-4523-b7f8-9c97bfac94c6): created successfully Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f6117ed-de6a-4024-87c4-a271d6013bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] Flow 'volume_create_manager' (a09ac0fb-1ef4-45a7-bfc0-30fb56d74ab5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:54:43 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-582f851b-d5e8-4c14-8a26-59a5e34d7adf tempest-CreateVolumesFromSnapshotTest-2062994582 None] Created volume successfully. Apr 25 15:54:44 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9c352deb-b91e-4c76-9b07-38997a29f537 tempest-VolumeTypesAccessTest-61355348 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-21c48181-172f-44db-8adc-59b99cdb9555" returned: 0 in 0.509s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9c352deb-b91e-4c76-9b07-38997a29f537 tempest-VolumeTypesAccessTest-61355348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-21c48181-172f-44db-8adc-59b99cdb9555 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:44 devstack sudo[88591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-21c48181-172f-44db-8adc-59b99cdb9555 Apr 25 15:54:44 devstack sudo[88591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:44 devstack sudo[88583]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1007ee6c-9898-4800-b939-bb34f6f537e4 1073741824" returned: 0 in 0.601s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1007ee6c-9898-4800-b939-bb34f6f537e4 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:44 devstack sudo[88593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1007ee6c-9898-4800-b939-bb34f6f537e4 Apr 25 15:54:44 devstack sudo[88593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:44 devstack sudo[88591]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9c352deb-b91e-4c76-9b07-38997a29f537 tempest-VolumeTypesAccessTest-61355348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-21c48181-172f-44db-8adc-59b99cdb9555" returned: 0 in 0.462s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:44 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9c352deb-b91e-4c76-9b07-38997a29f537 tempest-VolumeTypesAccessTest-61355348 None] Lock "cinder-quobyte-21c48181-172f-44db-8adc-59b99cdb9555" released by "delete_volume" :: held 1.092s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:44 devstack cinder-volume[81828]: WARNING cinder.quota [None req-9c352deb-b91e-4c76-9b07-38997a29f537 tempest-VolumeTypesAccessTest-61355348 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1864266920 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1864266920, it is now deprecated. Please use the default quota class for default quota. Apr 25 15:54:44 devstack cinder-volume[81828]: WARNING cinder.quota [None req-9c352deb-b91e-4c76-9b07-38997a29f537 tempest-VolumeTypesAccessTest-61355348 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1864266920 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1864266920, it is now deprecated. Please use the default quota class for default quota. Apr 25 15:54:44 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-9c352deb-b91e-4c76-9b07-38997a29f537 tempest-VolumeTypesAccessTest-61355348 None] Created reservations ['0ecfaa03-b6a3-4a6f-a1c8-faccfd549619', 'ced7bb36-40c4-40b2-801e-10e70b24ad74', '6ff11660-22d0-4cae-a2f4-640b34be14e1', 'b1e16166-6e4a-4835-afd8-0188316d3235'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:54:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9c352deb-b91e-4c76-9b07-38997a29f537 tempest-VolumeTypesAccessTest-61355348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9c352deb-b91e-4c76-9b07-38997a29f537 tempest-VolumeTypesAccessTest-61355348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-9c352deb-b91e-4c76-9b07-38997a29f537 tempest-VolumeTypesAccessTest-61355348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:54:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-9c352deb-b91e-4c76-9b07-38997a29f537 tempest-VolumeTypesAccessTest-61355348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:54:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9c352deb-b91e-4c76-9b07-38997a29f537 tempest-VolumeTypesAccessTest-61355348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9c352deb-b91e-4c76-9b07-38997a29f537 tempest-VolumeTypesAccessTest-61355348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:44 devstack sudo[88597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:54:44 devstack sudo[88597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:44 devstack sudo[88593]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1007ee6c-9898-4800-b939-bb34f6f537e4" returned: 0 in 0.468s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:54:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.764s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2126115288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db3934b6-dd49-4e04-a6f4-4c2fa6d6571a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b1d09257ff0472d8d6dcbba5be5ec3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:54:43Z,use_quota=True,user_id='ad96c1171e334a57802ec21c3a6563f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:54:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Creating volume db3934b6-dd49-4e04-a6f4-4c2fa6d6571a {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:54:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:54:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:54:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:54:44 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:54:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-db3934b6-dd49-4e04-a6f4-4c2fa6d6571a 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:44 devstack sudo[88599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-db3934b6-dd49-4e04-a6f4-4c2fa6d6571a 1073741824 Apr 25 15:54:44 devstack sudo[88599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3943440-3d77-4672-9c9d-52c4375ef4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1007ee6c-9898-4800-b939-bb34f6f537e4', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b9f5a7-35a9-48a5-b41e-f7e14753f964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:44 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Volume volume-1007ee6c-9898-4800-b939-bb34f6f537e4 (1007ee6c-9898-4800-b939-bb34f6f537e4): created successfully Apr 25 15:54:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7b9f5a7-35a9-48a5-b41e-f7e14753f964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Flow 'volume_create_manager' (1bb9fdd4-a41f-4b36-bf20-7c0f696411fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:54:44 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-9cf1d493-2eb7-4ede-b3e1-b1dd954a9729 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Created volume successfully. Apr 25 15:54:45 devstack sudo[88597]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9c352deb-b91e-4c76-9b07-38997a29f537 tempest-VolumeTypesAccessTest-61355348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.453s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:45 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-9c352deb-b91e-4c76-9b07-38997a29f537 tempest-VolumeTypesAccessTest-61355348 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:54:45 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-9c352deb-b91e-4c76-9b07-38997a29f537 tempest-VolumeTypesAccessTest-61355348 None] Deleted volume successfully. Apr 25 15:54:45 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9c352deb-b91e-4c76-9b07-38997a29f537 tempest-VolumeTypesAccessTest-61355348 None] Lock "cinder-21c48181-172f-44db-8adc-59b99cdb9555-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:45 devstack sudo[88599]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-db3934b6-dd49-4e04-a6f4-4c2fa6d6571a 1073741824" returned: 0 in 0.626s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-db3934b6-dd49-4e04-a6f4-4c2fa6d6571a {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:45 devstack sudo[88605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-db3934b6-dd49-4e04-a6f4-4c2fa6d6571a Apr 25 15:54:45 devstack sudo[88605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:46 devstack sudo[88605]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-db3934b6-dd49-4e04-a6f4-4c2fa6d6571a" returned: 0 in 0.516s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:46 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:54:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.623s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:46 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1014959997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14a90b6-9e98-4878-8bdf-e6eb1c89fc52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b1d09257ff0472d8d6dcbba5be5ec3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:54:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:54:43Z,use_quota=True,user_id='ad96c1171e334a57802ec21c3a6563f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:54:46 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Creating volume f14a90b6-9e98-4878-8bdf-e6eb1c89fc52 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:54:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:46 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:54:46 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:54:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:46 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:54:46 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:54:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f14a90b6-9e98-4878-8bdf-e6eb1c89fc52 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b13d8149-c013-440d-89fa-28e99e780239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db3934b6-dd49-4e04-a6f4-4c2fa6d6571a', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:46 devstack sudo[88608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f14a90b6-9e98-4878-8bdf-e6eb1c89fc52 1073741824 Apr 25 15:54:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b2730f5-df7d-4df2-8244-c2e8453c28df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:46 devstack sudo[88608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:46 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Volume volume-db3934b6-dd49-4e04-a6f4-4c2fa6d6571a (db3934b6-dd49-4e04-a6f4-4c2fa6d6571a): created successfully Apr 25 15:54:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b2730f5-df7d-4df2-8244-c2e8453c28df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Flow 'volume_create_manager' (e491fd64-2f2f-491c-aa25-f35583c8daf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:54:46 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-b39f1676-b1cf-460a-b650-7770800a3598 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Created volume successfully. Apr 25 15:54:46 devstack sudo[88608]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f14a90b6-9e98-4878-8bdf-e6eb1c89fc52 1073741824" returned: 0 in 0.657s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f14a90b6-9e98-4878-8bdf-e6eb1c89fc52 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:46 devstack sudo[88613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f14a90b6-9e98-4878-8bdf-e6eb1c89fc52 Apr 25 15:54:46 devstack sudo[88613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:47 devstack sudo[88613]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f14a90b6-9e98-4878-8bdf-e6eb1c89fc52" returned: 0 in 0.493s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:54:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.574s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1580042531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=136a04d4-bc97-4f4c-9744-1317f97063ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b1d09257ff0472d8d6dcbba5be5ec3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:54:44Z,use_quota=True,user_id='ad96c1171e334a57802ec21c3a6563f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:54:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Creating volume 136a04d4-bc97-4f4c-9744-1317f97063ad {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:54:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:54:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:54:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:54:47 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:54:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-136a04d4-bc97-4f4c-9744-1317f97063ad 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f858404b-9b21-4302-a85f-e173bdf6d7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f14a90b6-9e98-4878-8bdf-e6eb1c89fc52', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:47 devstack sudo[88616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-136a04d4-bc97-4f4c-9744-1317f97063ad 1073741824 Apr 25 15:54:47 devstack sudo[88616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf21524a-95d2-4d2f-a425-5465026eee03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:47 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Volume volume-f14a90b6-9e98-4878-8bdf-e6eb1c89fc52 (f14a90b6-9e98-4878-8bdf-e6eb1c89fc52): created successfully Apr 25 15:54:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf21524a-95d2-4d2f-a425-5465026eee03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Flow 'volume_create_manager' (f8514f69-1619-415e-91c1-312b0d45ce15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:54:47 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-01d9fb76-f13a-418c-a0eb-4c300065590f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Created volume successfully. Apr 25 15:54:47 devstack sudo[88616]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-136a04d4-bc97-4f4c-9744-1317f97063ad 1073741824" returned: 0 in 0.699s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-136a04d4-bc97-4f4c-9744-1317f97063ad {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:48 devstack sudo[88621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-136a04d4-bc97-4f4c-9744-1317f97063ad Apr 25 15:54:48 devstack sudo[88621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:48 devstack sudo[88621]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-136a04d4-bc97-4f4c-9744-1317f97063ad" returned: 0 in 0.495s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:48 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:54:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b208eaf6-adf7-4bed-9cfe-89859f95f6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-136a04d4-bc97-4f4c-9744-1317f97063ad', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea3db317-3309-4135-b5b9-8774d8dca8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:54:48 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Volume volume-136a04d4-bc97-4f4c-9744-1317f97063ad (136a04d4-bc97-4f4c-9744-1317f97063ad): created successfully Apr 25 15:54:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea3db317-3309-4135-b5b9-8774d8dca8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:54:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Flow 'volume_create_manager' (6285b005-6d10-4592-8386-89ab4abfad93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:54:48 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-c29074b8-240e-412f-9340-376990769443 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Created volume successfully. Apr 25 15:54:49 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9014269c-1ad0-407b-9f14-43021915b625 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "cinder-136a04d4-bc97-4f4c-9744-1317f97063ad-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:49 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9014269c-1ad0-407b-9f14-43021915b625 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "cinder-136a04d4-bc97-4f4c-9744-1317f97063ad-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:49 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9014269c-1ad0-407b-9f14-43021915b625 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "cinder-quobyte-136a04d4-bc97-4f4c-9744-1317f97063ad" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:49 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9014269c-1ad0-407b-9f14-43021915b625 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "cinder-quobyte-136a04d4-bc97-4f4c-9744-1317f97063ad" acquired by "delete_volume" :: waited 0.018s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:49 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8317d1c-a79d-4301-8ae1-ef30abe36817]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:54:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9014269c-1ad0-407b-9f14-43021915b625 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-136a04d4-bc97-4f4c-9744-1317f97063ad {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:49 devstack sudo[88624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-136a04d4-bc97-4f4c-9744-1317f97063ad Apr 25 15:54:49 devstack sudo[88624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:49 devstack sudo[88624]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9014269c-1ad0-407b-9f14-43021915b625 tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-136a04d4-bc97-4f4c-9744-1317f97063ad" returned: 0 in 0.595s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9014269c-1ad0-407b-9f14-43021915b625 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-136a04d4-bc97-4f4c-9744-1317f97063ad {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:49 devstack sudo[88629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-136a04d4-bc97-4f4c-9744-1317f97063ad Apr 25 15:54:49 devstack sudo[88629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:50 devstack sudo[88629]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9014269c-1ad0-407b-9f14-43021915b625 tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-136a04d4-bc97-4f4c-9744-1317f97063ad" returned: 0 in 0.497s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:50 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9014269c-1ad0-407b-9f14-43021915b625 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "cinder-quobyte-136a04d4-bc97-4f4c-9744-1317f97063ad" released by "delete_volume" :: held 1.137s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:50 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-9014269c-1ad0-407b-9f14-43021915b625 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Created reservations ['c4796a65-7e37-4ac4-8045-287a28f9792e', 'c0bcca47-733d-449c-b668-1f946b736313', 'f710ce76-98c1-4557-bc93-85dc29279296', 'd9984029-683c-4de7-9c5c-788edb92244d'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:54:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9014269c-1ad0-407b-9f14-43021915b625 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9014269c-1ad0-407b-9f14-43021915b625 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:50 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-9014269c-1ad0-407b-9f14-43021915b625 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:54:50 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-9014269c-1ad0-407b-9f14-43021915b625 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:54:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9014269c-1ad0-407b-9f14-43021915b625 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9014269c-1ad0-407b-9f14-43021915b625 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:50 devstack sudo[88632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:54:50 devstack sudo[88632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:50 devstack sudo[88632]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9014269c-1ad0-407b-9f14-43021915b625 tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.511s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:50 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-9014269c-1ad0-407b-9f14-43021915b625 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:54:50 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-9014269c-1ad0-407b-9f14-43021915b625 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Deleted volume successfully. Apr 25 15:54:51 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9014269c-1ad0-407b-9f14-43021915b625 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "cinder-136a04d4-bc97-4f4c-9744-1317f97063ad-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:51 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e9a9f605-a929-4e1c-a2fe-5602e41f8ae1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "cinder-f14a90b6-9e98-4878-8bdf-e6eb1c89fc52-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:51 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e9a9f605-a929-4e1c-a2fe-5602e41f8ae1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "cinder-f14a90b6-9e98-4878-8bdf-e6eb1c89fc52-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:51 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e9a9f605-a929-4e1c-a2fe-5602e41f8ae1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "cinder-quobyte-f14a90b6-9e98-4878-8bdf-e6eb1c89fc52" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:51 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e9a9f605-a929-4e1c-a2fe-5602e41f8ae1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "cinder-quobyte-f14a90b6-9e98-4878-8bdf-e6eb1c89fc52" acquired by "delete_volume" :: waited 0.020s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:51 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf77fa97-2de3-418e-90df-6f17409637b5]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:54:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e9a9f605-a929-4e1c-a2fe-5602e41f8ae1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f14a90b6-9e98-4878-8bdf-e6eb1c89fc52 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:51 devstack sudo[88642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f14a90b6-9e98-4878-8bdf-e6eb1c89fc52 Apr 25 15:54:51 devstack sudo[88642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:52 devstack sudo[88642]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e9a9f605-a929-4e1c-a2fe-5602e41f8ae1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f14a90b6-9e98-4878-8bdf-e6eb1c89fc52" returned: 0 in 0.572s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e9a9f605-a929-4e1c-a2fe-5602e41f8ae1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f14a90b6-9e98-4878-8bdf-e6eb1c89fc52 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:52 devstack sudo[88648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f14a90b6-9e98-4878-8bdf-e6eb1c89fc52 Apr 25 15:54:52 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:52 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e9a9f605-a929-4e1c-a2fe-5602e41f8ae1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f14a90b6-9e98-4878-8bdf-e6eb1c89fc52" returned: 0 in 0.517s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:52 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e9a9f605-a929-4e1c-a2fe-5602e41f8ae1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "cinder-quobyte-f14a90b6-9e98-4878-8bdf-e6eb1c89fc52" released by "delete_volume" :: held 1.127s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:52 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-e9a9f605-a929-4e1c-a2fe-5602e41f8ae1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Created reservations ['e2107a2d-2730-41c2-a3c1-d697ec9e0071', '94de78e2-c88c-442b-916a-e74b08277a91', 'e2ee02f6-da45-4873-853c-decea3068339', '11e3ad64-37df-4a06-88f0-0982918e43a1'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:54:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e9a9f605-a929-4e1c-a2fe-5602e41f8ae1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e9a9f605-a929-4e1c-a2fe-5602e41f8ae1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:52 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e9a9f605-a929-4e1c-a2fe-5602e41f8ae1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:54:52 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e9a9f605-a929-4e1c-a2fe-5602e41f8ae1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:54:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e9a9f605-a929-4e1c-a2fe-5602e41f8ae1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e9a9f605-a929-4e1c-a2fe-5602e41f8ae1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:52 devstack sudo[88651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:54:52 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:53 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e9a9f605-a929-4e1c-a2fe-5602e41f8ae1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.473s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:53 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-e9a9f605-a929-4e1c-a2fe-5602e41f8ae1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:54:53 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-e9a9f605-a929-4e1c-a2fe-5602e41f8ae1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Deleted volume successfully. Apr 25 15:54:53 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e9a9f605-a929-4e1c-a2fe-5602e41f8ae1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "cinder-f14a90b6-9e98-4878-8bdf-e6eb1c89fc52-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:53 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a39c5eda-56eb-48a7-bc00-43983ddd8e83 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "cinder-db3934b6-dd49-4e04-a6f4-4c2fa6d6571a-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:53 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a39c5eda-56eb-48a7-bc00-43983ddd8e83 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "cinder-db3934b6-dd49-4e04-a6f4-4c2fa6d6571a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:53 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a39c5eda-56eb-48a7-bc00-43983ddd8e83 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "cinder-quobyte-db3934b6-dd49-4e04-a6f4-4c2fa6d6571a" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:53 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a39c5eda-56eb-48a7-bc00-43983ddd8e83 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "cinder-quobyte-db3934b6-dd49-4e04-a6f4-4c2fa6d6571a" acquired by "delete_volume" :: waited 0.016s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:53 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[25283af9-e0bb-4d40-808d-49ca220d8203]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:54:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a39c5eda-56eb-48a7-bc00-43983ddd8e83 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-db3934b6-dd49-4e04-a6f4-4c2fa6d6571a {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:53 devstack sudo[88654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-db3934b6-dd49-4e04-a6f4-4c2fa6d6571a Apr 25 15:54:53 devstack sudo[88654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:54 devstack sudo[88654]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a39c5eda-56eb-48a7-bc00-43983ddd8e83 tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-db3934b6-dd49-4e04-a6f4-4c2fa6d6571a" returned: 0 in 0.547s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a39c5eda-56eb-48a7-bc00-43983ddd8e83 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-db3934b6-dd49-4e04-a6f4-4c2fa6d6571a {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:54 devstack sudo[88659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-db3934b6-dd49-4e04-a6f4-4c2fa6d6571a Apr 25 15:54:54 devstack sudo[88659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:54 devstack sudo[88659]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a39c5eda-56eb-48a7-bc00-43983ddd8e83 tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-db3934b6-dd49-4e04-a6f4-4c2fa6d6571a" returned: 0 in 0.581s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:54 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a39c5eda-56eb-48a7-bc00-43983ddd8e83 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "cinder-quobyte-db3934b6-dd49-4e04-a6f4-4c2fa6d6571a" released by "delete_volume" :: held 1.167s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:54 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-a39c5eda-56eb-48a7-bc00-43983ddd8e83 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Created reservations ['d8e64023-51e0-445c-a7ec-9d3702ca0ece', '881c907d-12e3-4f8b-89c3-123a08ac1ab3', 'a94a1809-dec5-41dc-9dc6-5749e6c7383b', 'b69c5299-27f2-4252-b657-9ffb893c440e'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:54:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-a39c5eda-56eb-48a7-bc00-43983ddd8e83 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-a39c5eda-56eb-48a7-bc00-43983ddd8e83 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:54 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-a39c5eda-56eb-48a7-bc00-43983ddd8e83 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:54:54 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-a39c5eda-56eb-48a7-bc00-43983ddd8e83 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:54:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-a39c5eda-56eb-48a7-bc00-43983ddd8e83 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a39c5eda-56eb-48a7-bc00-43983ddd8e83 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:54 devstack sudo[88662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:54:54 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:55 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a39c5eda-56eb-48a7-bc00-43983ddd8e83 tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.474s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:55 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-a39c5eda-56eb-48a7-bc00-43983ddd8e83 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:54:55 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-a39c5eda-56eb-48a7-bc00-43983ddd8e83 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Deleted volume successfully. Apr 25 15:54:55 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a39c5eda-56eb-48a7-bc00-43983ddd8e83 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "cinder-db3934b6-dd49-4e04-a6f4-4c2fa6d6571a-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:55 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b0799eca-7308-4836-b670-0876de808210 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "cinder-1007ee6c-9898-4800-b939-bb34f6f537e4-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:55 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b0799eca-7308-4836-b670-0876de808210 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "cinder-1007ee6c-9898-4800-b939-bb34f6f537e4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:55 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b0799eca-7308-4836-b670-0876de808210 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "cinder-quobyte-1007ee6c-9898-4800-b939-bb34f6f537e4" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:55 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b0799eca-7308-4836-b670-0876de808210 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "cinder-quobyte-1007ee6c-9898-4800-b939-bb34f6f537e4" acquired by "delete_volume" :: waited 0.019s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:55 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba65012-9197-41cc-a898-7552c30898d0]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:54:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b0799eca-7308-4836-b670-0876de808210 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1007ee6c-9898-4800-b939-bb34f6f537e4 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:56 devstack sudo[88665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1007ee6c-9898-4800-b939-bb34f6f537e4 Apr 25 15:54:56 devstack sudo[88665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:56 devstack sudo[88665]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b0799eca-7308-4836-b670-0876de808210 tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1007ee6c-9898-4800-b939-bb34f6f537e4" returned: 0 in 0.583s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b0799eca-7308-4836-b670-0876de808210 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1007ee6c-9898-4800-b939-bb34f6f537e4 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:56 devstack sudo[88670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1007ee6c-9898-4800-b939-bb34f6f537e4 Apr 25 15:54:56 devstack sudo[88670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:57 devstack sudo[88670]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b0799eca-7308-4836-b670-0876de808210 tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1007ee6c-9898-4800-b939-bb34f6f537e4" returned: 0 in 0.525s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:57 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b0799eca-7308-4836-b670-0876de808210 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "cinder-quobyte-1007ee6c-9898-4800-b939-bb34f6f537e4" released by "delete_volume" :: held 1.149s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:57 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-b0799eca-7308-4836-b670-0876de808210 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Created reservations ['dcda5a89-e153-4f6b-bf60-7662a59ccfab', '46f9a516-9f3d-427f-829b-bd2df87a85fb', 'fea0a18a-5207-4d4a-ab89-54bf234ced86', '6f0edafe-0f1d-4f04-81da-b502dd164733'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:54:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b0799eca-7308-4836-b670-0876de808210 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b0799eca-7308-4836-b670-0876de808210 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:57 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b0799eca-7308-4836-b670-0876de808210 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:54:57 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b0799eca-7308-4836-b670-0876de808210 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:54:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b0799eca-7308-4836-b670-0876de808210 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b0799eca-7308-4836-b670-0876de808210 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:57 devstack sudo[88673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:54:57 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:57 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b0799eca-7308-4836-b670-0876de808210 tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.473s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:57 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-b0799eca-7308-4836-b670-0876de808210 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:54:57 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-b0799eca-7308-4836-b670-0876de808210 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Deleted volume successfully. Apr 25 15:54:57 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b0799eca-7308-4836-b670-0876de808210 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "cinder-1007ee6c-9898-4800-b939-bb34f6f537e4-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:58 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-4444c62e-25f8-4da2-a170-bddd0ba386c1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "cinder-b22f90fc-687e-4523-b7f8-9c97bfac94c6-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:58 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-4444c62e-25f8-4da2-a170-bddd0ba386c1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "cinder-b22f90fc-687e-4523-b7f8-9c97bfac94c6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:58 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-4444c62e-25f8-4da2-a170-bddd0ba386c1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "cinder-quobyte-b22f90fc-687e-4523-b7f8-9c97bfac94c6" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:54:58 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-4444c62e-25f8-4da2-a170-bddd0ba386c1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "cinder-quobyte-b22f90fc-687e-4523-b7f8-9c97bfac94c6" acquired by "delete_volume" :: waited 0.018s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:54:58 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade06b1f-e5be-4ddb-936a-a619056f7837]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:54:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4444c62e-25f8-4da2-a170-bddd0ba386c1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b22f90fc-687e-4523-b7f8-9c97bfac94c6 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:58 devstack sudo[88676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b22f90fc-687e-4523-b7f8-9c97bfac94c6 Apr 25 15:54:58 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:58 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4444c62e-25f8-4da2-a170-bddd0ba386c1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b22f90fc-687e-4523-b7f8-9c97bfac94c6" returned: 0 in 0.546s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4444c62e-25f8-4da2-a170-bddd0ba386c1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b22f90fc-687e-4523-b7f8-9c97bfac94c6 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:58 devstack sudo[88681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b22f90fc-687e-4523-b7f8-9c97bfac94c6 Apr 25 15:54:58 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:59 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4444c62e-25f8-4da2-a170-bddd0ba386c1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b22f90fc-687e-4523-b7f8-9c97bfac94c6" returned: 0 in 0.439s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:59 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-4444c62e-25f8-4da2-a170-bddd0ba386c1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "cinder-quobyte-b22f90fc-687e-4523-b7f8-9c97bfac94c6" released by "delete_volume" :: held 1.030s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:54:59 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-4444c62e-25f8-4da2-a170-bddd0ba386c1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Created reservations ['cb28f908-7cf8-4f8c-9a30-a59abef1fe0c', 'b39b5ad7-b5b8-4495-b332-04031cdb7b0f', '84641c49-8543-4f0e-914e-1df279249946', '29adc8d7-1af6-4418-b3b1-e602ddbf2882'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:54:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4444c62e-25f8-4da2-a170-bddd0ba386c1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:54:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4444c62e-25f8-4da2-a170-bddd0ba386c1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:54:59 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4444c62e-25f8-4da2-a170-bddd0ba386c1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:54:59 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4444c62e-25f8-4da2-a170-bddd0ba386c1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:54:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4444c62e-25f8-4da2-a170-bddd0ba386c1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:54:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4444c62e-25f8-4da2-a170-bddd0ba386c1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:54:59 devstack sudo[88684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:54:59 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:54:59 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root Apr 25 15:54:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4444c62e-25f8-4da2-a170-bddd0ba386c1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.483s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:54:59 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-4444c62e-25f8-4da2-a170-bddd0ba386c1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:54:59 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-4444c62e-25f8-4da2-a170-bddd0ba386c1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Deleted volume successfully. Apr 25 15:54:59 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-4444c62e-25f8-4da2-a170-bddd0ba386c1 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "cinder-b22f90fc-687e-4523-b7f8-9c97bfac94c6-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:55:00 devstack cinder-volume[81828]: DEBUG oslo_service.periodic_task [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81828) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 25 15:55:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:55:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:55:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:55:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:55:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:55:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:00 devstack sudo[88687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:55:00 devstack sudo[88687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:00 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-647acf83-356d-4b6a-8fe1-8e35beb67d49 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "cinder-cbea59de-da7e-44d0-86d3-d5b286aebb30-delete_snapshot" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:55:00 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-647acf83-356d-4b6a-8fe1-8e35beb67d49 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "cinder-cbea59de-da7e-44d0-86d3-d5b286aebb30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:55:00 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-647acf83-356d-4b6a-8fe1-8e35beb67d49 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "cinder-quobyte-105ba519-0bc8-49bd-99f8-5016a9f69998" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:55:00 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-647acf83-356d-4b6a-8fe1-8e35beb67d49 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "cinder-quobyte-105ba519-0bc8-49bd-99f8-5016a9f69998" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:55:00 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-647acf83-356d-4b6a-8fe1-8e35beb67d49 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "cinder-quobyte-cbea59de-da7e-44d0-86d3-d5b286aebb30" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:55:00 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-647acf83-356d-4b6a-8fe1-8e35beb67d49 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "cinder-quobyte-cbea59de-da7e-44d0-86d3-d5b286aebb30" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:55:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-647acf83-356d-4b6a-8fe1-8e35beb67d49 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Deleting offline snapshot cbea59de-da7e-44d0-86d3-d5b286aebb30 of volume 105ba519-0bc8-49bd-99f8-5016a9f69998 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 15:55:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-647acf83-356d-4b6a-8fe1-8e35beb67d49 tempest-CreateVolumesFromSnapshotTest-2062994582 None] snapshot_file for this snap is: volume-105ba519-0bc8-49bd-99f8-5016a9f69998.cbea59de-da7e-44d0-86d3-d5b286aebb30 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 15:55:00 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[0949902e-a74d-4639-a1bb-a7759eaf05b7]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:55:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-647acf83-356d-4b6a-8fe1-8e35beb67d49 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998.cbea59de-da7e-44d0-86d3-d5b286aebb30 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:00 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998.cbea59de-da7e-44d0-86d3-d5b286aebb30 Apr 25 15:55:00 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:00 devstack sudo[88687]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.573s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:00 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:55:01 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-647acf83-356d-4b6a-8fe1-8e35beb67d49 tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998.cbea59de-da7e-44d0-86d3-d5b286aebb30" returned: 0 in 0.620s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:01 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-647acf83-356d-4b6a-8fe1-8e35beb67d49 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-105ba519-0bc8-49bd-99f8-5016a9f69998(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:55:01 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ca87f2-3a10-4783-bc5e-25a570c0dd1d]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:55:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-647acf83-356d-4b6a-8fe1-8e35beb67d49 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:01 devstack sudo[88695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998 Apr 25 15:55:01 devstack sudo[88695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:01 devstack sudo[88695]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-647acf83-356d-4b6a-8fe1-8e35beb67d49 tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998" returned: 0 in 0.579s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-647acf83-356d-4b6a-8fe1-8e35beb67d49 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998.cbea59de-da7e-44d0-86d3-d5b286aebb30 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:01 devstack sudo[88701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998.cbea59de-da7e-44d0-86d3-d5b286aebb30 Apr 25 15:55:01 devstack sudo[88701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:02 devstack sudo[88701]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-647acf83-356d-4b6a-8fe1-8e35beb67d49 tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998.cbea59de-da7e-44d0-86d3-d5b286aebb30" returned: 0 in 0.595s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-647acf83-356d-4b6a-8fe1-8e35beb67d49 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998.cbea59de-da7e-44d0-86d3-d5b286aebb30 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:02 devstack sudo[88706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998.cbea59de-da7e-44d0-86d3-d5b286aebb30 Apr 25 15:55:02 devstack sudo[88706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:02 devstack sudo[88706]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-647acf83-356d-4b6a-8fe1-8e35beb67d49 tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998.cbea59de-da7e-44d0-86d3-d5b286aebb30" returned: 0 in 0.482s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:02 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-647acf83-356d-4b6a-8fe1-8e35beb67d49 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "cinder-quobyte-cbea59de-da7e-44d0-86d3-d5b286aebb30" released by "_delete_snapshot" :: held 2.398s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:55:02 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-647acf83-356d-4b6a-8fe1-8e35beb67d49 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "cinder-quobyte-105ba519-0bc8-49bd-99f8-5016a9f69998" released by "delete_snapshot" :: held 2.421s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:55:02 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-647acf83-356d-4b6a-8fe1-8e35beb67d49 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Created reservations ['0e0c71a6-d7ac-4978-8159-2f74dd276af6', '25d51fad-2463-46ed-8dc1-a4728f1d927f', 'f3e28cde-a014-47b7-a20f-87b94750c550', 'bd4eb584-cedc-488c-9940-9e25d79e303e'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:55:02 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-647acf83-356d-4b6a-8fe1-8e35beb67d49 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Delete snapshot completed successfully. Apr 25 15:55:02 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-647acf83-356d-4b6a-8fe1-8e35beb67d49 tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "cinder-cbea59de-da7e-44d0-86d3-d5b286aebb30-delete_snapshot" released by "delete_snapshot" :: held 2.565s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:55:03 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c83b1470-b305-445f-82e9-d3b582263e6f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "cinder-105ba519-0bc8-49bd-99f8-5016a9f69998-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:55:03 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c83b1470-b305-445f-82e9-d3b582263e6f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "cinder-105ba519-0bc8-49bd-99f8-5016a9f69998-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:55:03 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:SELECT=146,cinder:INSERT=51,cinder:UPDATE=207,cinder:DELETE=16 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:55:03 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:SELECT=133,cinder:INSERT=38,cinder:UPDATE=181,cinder:DELETE=12 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:55:03 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c83b1470-b305-445f-82e9-d3b582263e6f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "cinder-quobyte-105ba519-0bc8-49bd-99f8-5016a9f69998" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:55:03 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c83b1470-b305-445f-82e9-d3b582263e6f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "cinder-quobyte-105ba519-0bc8-49bd-99f8-5016a9f69998" acquired by "delete_volume" :: waited 0.020s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:55:03 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[85153105-342c-4051-b8e3-8108eded8e35]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:55:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c83b1470-b305-445f-82e9-d3b582263e6f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:03 devstack sudo[88850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998 Apr 25 15:55:03 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:04 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c83b1470-b305-445f-82e9-d3b582263e6f tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998" returned: 0 in 0.573s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c83b1470-b305-445f-82e9-d3b582263e6f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:04 devstack sudo[88855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998 Apr 25 15:55:04 devstack sudo[88855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:04 devstack sudo[88855]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c83b1470-b305-445f-82e9-d3b582263e6f tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-105ba519-0bc8-49bd-99f8-5016a9f69998" returned: 0 in 0.476s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:04 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c83b1470-b305-445f-82e9-d3b582263e6f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "cinder-quobyte-105ba519-0bc8-49bd-99f8-5016a9f69998" released by "delete_volume" :: held 1.112s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:55:04 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-c83b1470-b305-445f-82e9-d3b582263e6f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Created reservations ['a2bd28d4-f410-475b-bf02-de3cf733d701', '40cfee58-b8b5-4664-b23b-fdd635ccc677', '783d9d4d-5910-40eb-a942-7e646c977163', '1979f3a3-656a-49a1-8ab2-478fa70afbf3'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:55:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c83b1470-b305-445f-82e9-d3b582263e6f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:55:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c83b1470-b305-445f-82e9-d3b582263e6f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:55:04 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c83b1470-b305-445f-82e9-d3b582263e6f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:55:04 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c83b1470-b305-445f-82e9-d3b582263e6f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:55:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c83b1470-b305-445f-82e9-d3b582263e6f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:55:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c83b1470-b305-445f-82e9-d3b582263e6f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:04 devstack sudo[88858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:55:04 devstack sudo[88858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:05 devstack sudo[88858]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c83b1470-b305-445f-82e9-d3b582263e6f tempest-CreateVolumesFromSnapshotTest-2062994582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.553s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:05 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-c83b1470-b305-445f-82e9-d3b582263e6f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:55:05 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-c83b1470-b305-445f-82e9-d3b582263e6f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Deleted volume successfully. Apr 25 15:55:05 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c83b1470-b305-445f-82e9-d3b582263e6f tempest-CreateVolumesFromSnapshotTest-2062994582 None] Lock "cinder-105ba519-0bc8-49bd-99f8-5016a9f69998-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:55:08 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:55:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] Flow 'volume_create_manager' (d247dac8-5035-4734-afb1-de6bb4ce7c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:55:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f498c3-ad5f-46f5-8ec5-549cc1bf5e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1f498c3-ad5f-46f5-8ec5-549cc1bf5e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-27968317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c02318ff-5964-44ba-b91c-68c850013a36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76628ec206244af96e2fe85101d3b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:55:09Z,use_quota=True,user_id='b4396b2ce5b04e41bbf861f233aa2e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d16500-0bb6-4a87-aa3c-b9e007bf9e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d16500-0bb6-4a87-aa3c-b9e007bf9e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcee9414-8011-45cf-bf09-47fead26728a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcee9414-8011-45cf-bf09-47fead26728a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c02318ff-5964-44ba-b91c-68c850013a36', 'volume_name': 'volume-c02318ff-5964-44ba-b91c-68c850013a36', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a53b9279-3f58-4bc0-8083-d8ed5de208fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a53b9279-3f58-4bc0-8083-d8ed5de208fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:08 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a8f97f-890c-48ee-9371-025a4a1630e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:08 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] Volume c02318ff-5964-44ba-b91c-68c850013a36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c02318ff-5964-44ba-b91c-68c850013a36', 'volume_size': 1} Apr 25 15:55:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:55:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:55:08 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-27968317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c02318ff-5964-44ba-b91c-68c850013a36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76628ec206244af96e2fe85101d3b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:55:09Z,use_quota=True,user_id='b4396b2ce5b04e41bbf861f233aa2e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:55:08 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] Creating volume c02318ff-5964-44ba-b91c-68c850013a36 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:55:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:55:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:55:08 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:55:08 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:55:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:55:08 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:55:08 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:55:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:08 devstack sudo[88861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36 1073741824 Apr 25 15:55:08 devstack sudo[88861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:09 devstack sudo[88861]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36 1073741824" returned: 0 in 0.649s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:09 devstack sudo[88866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36 Apr 25 15:55:09 devstack sudo[88866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:09 devstack sudo[88866]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36" returned: 0 in 0.522s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:09 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:55:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:55:09 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a8f97f-890c-48ee-9371-025a4a1630e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c02318ff-5964-44ba-b91c-68c850013a36', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:09 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37421727-9801-4a1d-89f4-940b91e7c6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:09 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] Volume volume-c02318ff-5964-44ba-b91c-68c850013a36 (c02318ff-5964-44ba-b91c-68c850013a36): created successfully Apr 25 15:55:09 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37421727-9801-4a1d-89f4-940b91e7c6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:09 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] Flow 'volume_create_manager' (d247dac8-5035-4734-afb1-de6bb4ce7c73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:55:09 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-838f7827-6911-4af9-8130-068ded6eec62 tempest-VolumeDependencyTests-1092498908 None] Created volume successfully. Apr 25 15:55:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c2edfa3c-d00f-498b-a378-c82b490e2144 tempest-VolumeDependencyTests-1092498908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:55:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c2edfa3c-d00f-498b-a378-c82b490e2144 tempest-VolumeDependencyTests-1092498908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:55:10 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-c2edfa3c-d00f-498b-a378-c82b490e2144 tempest-VolumeDependencyTests-1092498908 None] Creating offline snapshot bf062ffc-d12c-4b93-aa08-8b18649e7c4a of volume c02318ff-5964-44ba-b91c-68c850013a36 {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 15:55:11 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b0676b-a050-4a80-8b57-929709858db3]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:55:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c2edfa3c-d00f-498b-a378-c82b490e2144 tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:11 devstack sudo[88869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36 Apr 25 15:55:11 devstack sudo[88869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:11 devstack sudo[88869]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c2edfa3c-d00f-498b-a378-c82b490e2144 tempest-VolumeDependencyTests-1092498908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36" returned: 0 in 0.595s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c2edfa3c-d00f-498b-a378-c82b490e2144 tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36.bf062ffc-d12c-4b93-aa08-8b18649e7c4a 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:11 devstack sudo[88992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36.bf062ffc-d12c-4b93-aa08-8b18649e7c4a 1G Apr 25 15:55:11 devstack sudo[88992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:12 devstack sudo[88992]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c2edfa3c-d00f-498b-a378-c82b490e2144 tempest-VolumeDependencyTests-1092498908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36.bf062ffc-d12c-4b93-aa08-8b18649e7c4a 1G" returned: 0 in 0.656s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c2edfa3c-d00f-498b-a378-c82b490e2144 tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c02318ff-5964-44ba-b91c-68c850013a36 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36.bf062ffc-d12c-4b93-aa08-8b18649e7c4a {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:12 devstack sudo[89002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c02318ff-5964-44ba-b91c-68c850013a36 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36.bf062ffc-d12c-4b93-aa08-8b18649e7c4a Apr 25 15:55:12 devstack sudo[89002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:12 devstack sudo[89002]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c2edfa3c-d00f-498b-a378-c82b490e2144 tempest-VolumeDependencyTests-1092498908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c02318ff-5964-44ba-b91c-68c850013a36 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36.bf062ffc-d12c-4b93-aa08-8b18649e7c4a" returned: 0 in 0.539s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:12 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-c2edfa3c-d00f-498b-a378-c82b490e2144 tempest-VolumeDependencyTests-1092498908 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36.bf062ffc-d12c-4b93-aa08-8b18649e7c4a is being set with open permissions: ugo+rw Apr 25 15:55:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c2edfa3c-d00f-498b-a378-c82b490e2144 tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36.bf062ffc-d12c-4b93-aa08-8b18649e7c4a {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:12 devstack sudo[89008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36.bf062ffc-d12c-4b93-aa08-8b18649e7c4a Apr 25 15:55:12 devstack sudo[89008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:13 devstack sudo[89008]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c2edfa3c-d00f-498b-a378-c82b490e2144 tempest-VolumeDependencyTests-1092498908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36.bf062ffc-d12c-4b93-aa08-8b18649e7c4a" returned: 0 in 0.432s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c2edfa3c-d00f-498b-a378-c82b490e2144 tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:13 devstack sudo[89011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36.info Apr 25 15:55:13 devstack sudo[89011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:13 devstack sudo[89011]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c2edfa3c-d00f-498b-a378-c82b490e2144 tempest-VolumeDependencyTests-1092498908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36.info" returned: 0 in 0.449s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:13 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-c2edfa3c-d00f-498b-a378-c82b490e2144 tempest-VolumeDependencyTests-1092498908 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36.info is being set with open permissions: ugo+rw Apr 25 15:55:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c2edfa3c-d00f-498b-a378-c82b490e2144 tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:13 devstack sudo[89014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36.info Apr 25 15:55:13 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:14 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c2edfa3c-d00f-498b-a378-c82b490e2144 tempest-VolumeDependencyTests-1092498908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36.info" returned: 0 in 0.439s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c2edfa3c-d00f-498b-a378-c82b490e2144 tempest-VolumeDependencyTests-1092498908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.195s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:55:14 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-c2edfa3c-d00f-498b-a378-c82b490e2144 tempest-VolumeDependencyTests-1092498908 None] Create snapshot completed successfully Apr 25 15:55:15 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:55:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Flow 'volume_create_manager' (97211056-4852-4cbb-8441-e388edb00dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:55:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97974809-b15e-4a8a-bf94-61c979c0edf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97974809-b15e-4a8a-bf94-61c979c0edf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:55:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1645499843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afa65097-a3fa-43e3-b538-2fdc13438897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76628ec206244af96e2fe85101d3b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:55:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bf062ffc-d12c-4b93-aa08-8b18649e7c4a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:55:15Z,use_quota=True,user_id='b4396b2ce5b04e41bbf861f233aa2e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac482519-d266-425c-b8b7-f1dfd3594f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac482519-d266-425c-b8b7-f1dfd3594f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4771a31-e76d-4d13-95f3-b2def1ab2e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4771a31-e76d-4d13-95f3-b2def1ab2e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'afa65097-a3fa-43e3-b538-2fdc13438897', 'volume_name': 'volume-afa65097-a3fa-43e3-b538-2fdc13438897', 'volume_size': 1, 'snapshot_id': 'bf062ffc-d12c-4b93-aa08-8b18649e7c4a'}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0c98cd5-df48-40a0-88aa-2280cd54af81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0c98cd5-df48-40a0-88aa-2280cd54af81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd98a9c-41f8-45cf-ab0b-c04f0c195913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:15 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Volume afa65097-a3fa-43e3-b538-2fdc13438897: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-afa65097-a3fa-43e3-b538-2fdc13438897', 'volume_size': 1, 'snapshot_id': 'bf062ffc-d12c-4b93-aa08-8b18649e7c4a'} Apr 25 15:55:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:55:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:55:15 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Acquiring lock "cinder-quobyte-bf062ffc-d12c-4b93-aa08-8b18649e7c4a-afa65097-a3fa-43e3-b538-2fdc13438897" by "_create_volume_from_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:55:15 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Lock "cinder-quobyte-bf062ffc-d12c-4b93-aa08-8b18649e7c4a-afa65097-a3fa-43e3-b538-2fdc13438897" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:55:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Creating volume afa65097-a3fa-43e3-b538-2fdc13438897 from snapshot bf062ffc-d12c-4b93-aa08-8b18649e7c4a {{(pid=81828) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 25 15:55:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:55:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:55:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:55:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:55:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:55:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:55:15 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Acquiring lock "cinder-quobyte-afa65097-a3fa-43e3-b538-2fdc13438897" by "_copy_volume_from_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:55:15 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Lock "cinder-quobyte-afa65097-a3fa-43e3-b538-2fdc13438897" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:55:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] snapshot: bf062ffc-d12c-4b93-aa08-8b18649e7c4a, volume: afa65097-a3fa-43e3-b538-2fdc13438897, {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 25 15:55:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:55:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:55:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:55:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:55:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:55:15 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12ceca9-6377-41f3-890f-e8ef4203e2bd]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:55:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36.bf062ffc-d12c-4b93-aa08-8b18649e7c4a {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:15 devstack sudo[89017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36.bf062ffc-d12c-4b93-aa08-8b18649e7c4a Apr 25 15:55:15 devstack sudo[89017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:16 devstack sudo[89017]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36.bf062ffc-d12c-4b93-aa08-8b18649e7c4a" returned: 0 in 0.540s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c02318ff-5964-44ba-b91c-68c850013a36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:55:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] will copy from snapshot at /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36 {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 25 15:55:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Creating direct copy from snapshot {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 25 15:55:16 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3b6758-95a2-4b3a-ba35-feab90c93120]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:55:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:16 devstack sudo[89022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36 Apr 25 15:55:16 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:16 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36" returned: 0 in 0.578s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:16 devstack cinder-volume[81828]: DEBUG cinder.utils [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Path /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-afa65097-a3fa-43e3-b538-2fdc13438897 not found in is_blk_device check {{(pid=81828) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 25 15:55:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-afa65097-a3fa-43e3-b538-2fdc13438897 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:16 devstack sudo[89027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-afa65097-a3fa-43e3-b538-2fdc13438897 Apr 25 15:55:16 devstack sudo[89027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:21 devstack sudo[89027]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-afa65097-a3fa-43e3-b538-2fdc13438897" returned: 0 in 5.130s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:21 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4329b8-8f86-4fc2-abf9-f37660a46578]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:55:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:22 devstack sudo[89056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36 Apr 25 15:55:22 devstack sudo[89056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:22 devstack sudo[89056]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36" returned: 0 in 0.650s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:22 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Image conversion details: src /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36, size 1024.00 MB, duration 5.13 sec, destination /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-afa65097-a3fa-43e3-b538-2fdc13438897 {{(pid=81828) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 15:55:22 devstack cinder-volume[81828]: INFO cinder.image.image_utils [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Converted 1024.00 MB image at 199.54 MB/s Apr 25 15:55:22 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-afa65097-a3fa-43e3-b538-2fdc13438897 is being set with open permissions: ugo+rw Apr 25 15:55:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-afa65097-a3fa-43e3-b538-2fdc13438897 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:22 devstack sudo[89061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-afa65097-a3fa-43e3-b538-2fdc13438897 Apr 25 15:55:22 devstack sudo[89061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:23 devstack sudo[89061]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-afa65097-a3fa-43e3-b538-2fdc13438897" returned: 0 in 0.456s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:23 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Lock "cinder-quobyte-afa65097-a3fa-43e3-b538-2fdc13438897" released by "_copy_volume_from_snapshot" :: held 7.439s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:55:23 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Lock "cinder-quobyte-bf062ffc-d12c-4b93-aa08-8b18649e7c4a-afa65097-a3fa-43e3-b538-2fdc13438897" released by "_create_volume_from_snapshot" :: held 7.473s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:55:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.490s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:55:23 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd98a9c-41f8-45cf-ab0b-c04f0c195913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afa65097-a3fa-43e3-b538-2fdc13438897', 'volume_size': 1, 'snapshot_id': 'bf062ffc-d12c-4b93-aa08-8b18649e7c4a'}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:23 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a2e026-fd85-4239-a370-edaf7b70546f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:23 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Volume volume-afa65097-a3fa-43e3-b538-2fdc13438897 (afa65097-a3fa-43e3-b538-2fdc13438897): created successfully Apr 25 15:55:23 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a2e026-fd85-4239-a370-edaf7b70546f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:23 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Flow 'volume_create_manager' (97211056-4852-4cbb-8441-e388edb00dac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:55:23 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-d30b03d1-3c08-4400-aa2b-d71eb22f5cbf tempest-VolumeDependencyTests-1092498908 None] Created volume successfully. Apr 25 15:55:24 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5633142c-87b3-44df-aa76-c1881435db52 tempest-VolumeDependencyTests-1092498908 None] Acquiring lock "cinder-bf062ffc-d12c-4b93-aa08-8b18649e7c4a-delete_snapshot" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:55:24 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5633142c-87b3-44df-aa76-c1881435db52 tempest-VolumeDependencyTests-1092498908 None] Lock "cinder-bf062ffc-d12c-4b93-aa08-8b18649e7c4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:55:24 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5633142c-87b3-44df-aa76-c1881435db52 tempest-VolumeDependencyTests-1092498908 None] Acquiring lock "cinder-quobyte-c02318ff-5964-44ba-b91c-68c850013a36" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:55:24 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5633142c-87b3-44df-aa76-c1881435db52 tempest-VolumeDependencyTests-1092498908 None] Lock "cinder-quobyte-c02318ff-5964-44ba-b91c-68c850013a36" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:55:24 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5633142c-87b3-44df-aa76-c1881435db52 tempest-VolumeDependencyTests-1092498908 None] Acquiring lock "cinder-quobyte-bf062ffc-d12c-4b93-aa08-8b18649e7c4a" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:55:24 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5633142c-87b3-44df-aa76-c1881435db52 tempest-VolumeDependencyTests-1092498908 None] Lock "cinder-quobyte-bf062ffc-d12c-4b93-aa08-8b18649e7c4a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:55:24 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-5633142c-87b3-44df-aa76-c1881435db52 tempest-VolumeDependencyTests-1092498908 None] Deleting offline snapshot bf062ffc-d12c-4b93-aa08-8b18649e7c4a of volume c02318ff-5964-44ba-b91c-68c850013a36 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 15:55:24 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-5633142c-87b3-44df-aa76-c1881435db52 tempest-VolumeDependencyTests-1092498908 None] snapshot_file for this snap is: volume-c02318ff-5964-44ba-b91c-68c850013a36.bf062ffc-d12c-4b93-aa08-8b18649e7c4a {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 15:55:24 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[37661925-5d47-4420-8eb2-112766ada8e1]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:55:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5633142c-87b3-44df-aa76-c1881435db52 tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36.bf062ffc-d12c-4b93-aa08-8b18649e7c4a {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:24 devstack sudo[89069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36.bf062ffc-d12c-4b93-aa08-8b18649e7c4a Apr 25 15:55:24 devstack sudo[89069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:24 devstack sudo[89069]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5633142c-87b3-44df-aa76-c1881435db52 tempest-VolumeDependencyTests-1092498908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36.bf062ffc-d12c-4b93-aa08-8b18649e7c4a" returned: 0 in 0.561s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:24 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-5633142c-87b3-44df-aa76-c1881435db52 tempest-VolumeDependencyTests-1092498908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c02318ff-5964-44ba-b91c-68c850013a36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:55:24 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c6ff76-85c7-413e-90f5-7a07a45a18a0]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:55:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5633142c-87b3-44df-aa76-c1881435db52 tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:25 devstack sudo[89080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36 Apr 25 15:55:25 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:25 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5633142c-87b3-44df-aa76-c1881435db52 tempest-VolumeDependencyTests-1092498908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36" returned: 0 in 0.532s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5633142c-87b3-44df-aa76-c1881435db52 tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36.bf062ffc-d12c-4b93-aa08-8b18649e7c4a {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:25 devstack sudo[89093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36.bf062ffc-d12c-4b93-aa08-8b18649e7c4a Apr 25 15:55:25 devstack sudo[89093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:26 devstack sudo[89093]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5633142c-87b3-44df-aa76-c1881435db52 tempest-VolumeDependencyTests-1092498908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36.bf062ffc-d12c-4b93-aa08-8b18649e7c4a" returned: 0 in 0.698s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5633142c-87b3-44df-aa76-c1881435db52 tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36.bf062ffc-d12c-4b93-aa08-8b18649e7c4a {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:26 devstack sudo[89124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36.bf062ffc-d12c-4b93-aa08-8b18649e7c4a Apr 25 15:55:26 devstack sudo[89124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:26 devstack sudo[89124]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5633142c-87b3-44df-aa76-c1881435db52 tempest-VolumeDependencyTests-1092498908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36.bf062ffc-d12c-4b93-aa08-8b18649e7c4a" returned: 0 in 0.572s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:26 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5633142c-87b3-44df-aa76-c1881435db52 tempest-VolumeDependencyTests-1092498908 None] Lock "cinder-quobyte-bf062ffc-d12c-4b93-aa08-8b18649e7c4a" released by "_delete_snapshot" :: held 2.467s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:55:26 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5633142c-87b3-44df-aa76-c1881435db52 tempest-VolumeDependencyTests-1092498908 None] Lock "cinder-quobyte-c02318ff-5964-44ba-b91c-68c850013a36" released by "delete_snapshot" :: held 2.495s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:55:26 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-5633142c-87b3-44df-aa76-c1881435db52 tempest-VolumeDependencyTests-1092498908 None] Created reservations ['b2887676-2df6-4aeb-8349-331bdef026c2', '66671c17-d7fe-4fc3-a2ed-f81c2813183c', '52c56150-b927-4a42-8147-26088f6811a4', 'dcfd7a3d-a3fe-4020-9380-a988c54da4e9'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:55:26 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-5633142c-87b3-44df-aa76-c1881435db52 tempest-VolumeDependencyTests-1092498908 None] Delete snapshot completed successfully. Apr 25 15:55:26 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5633142c-87b3-44df-aa76-c1881435db52 tempest-VolumeDependencyTests-1092498908 None] Lock "cinder-bf062ffc-d12c-4b93-aa08-8b18649e7c4a-delete_snapshot" released by "delete_snapshot" :: held 2.656s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:55:27 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-735974fa-5c66-480e-8f2a-ad140fdc3315 tempest-VolumeDependencyTests-1092498908 None] Acquiring lock "cinder-c02318ff-5964-44ba-b91c-68c850013a36-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:55:27 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-735974fa-5c66-480e-8f2a-ad140fdc3315 tempest-VolumeDependencyTests-1092498908 None] Lock "cinder-c02318ff-5964-44ba-b91c-68c850013a36-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:55:27 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-735974fa-5c66-480e-8f2a-ad140fdc3315 tempest-VolumeDependencyTests-1092498908 None] Acquiring lock "cinder-quobyte-c02318ff-5964-44ba-b91c-68c850013a36" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:55:27 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-735974fa-5c66-480e-8f2a-ad140fdc3315 tempest-VolumeDependencyTests-1092498908 None] Lock "cinder-quobyte-c02318ff-5964-44ba-b91c-68c850013a36" acquired by "delete_volume" :: waited 0.023s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:55:27 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[e898348c-3fb5-4577-93bd-36956da4c0a7]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:55:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-735974fa-5c66-480e-8f2a-ad140fdc3315 tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:27 devstack sudo[89135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36 Apr 25 15:55:27 devstack sudo[89135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:28 devstack sudo[89135]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-735974fa-5c66-480e-8f2a-ad140fdc3315 tempest-VolumeDependencyTests-1092498908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36" returned: 0 in 0.556s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-735974fa-5c66-480e-8f2a-ad140fdc3315 tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:28 devstack sudo[89140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36 Apr 25 15:55:28 devstack sudo[89140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:28 devstack sudo[89140]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-735974fa-5c66-480e-8f2a-ad140fdc3315 tempest-VolumeDependencyTests-1092498908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c02318ff-5964-44ba-b91c-68c850013a36" returned: 0 in 0.646s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:28 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-735974fa-5c66-480e-8f2a-ad140fdc3315 tempest-VolumeDependencyTests-1092498908 None] Lock "cinder-quobyte-c02318ff-5964-44ba-b91c-68c850013a36" released by "delete_volume" :: held 1.270s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:55:28 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-735974fa-5c66-480e-8f2a-ad140fdc3315 tempest-VolumeDependencyTests-1092498908 None] Created reservations ['48c75b2e-9aa3-4672-93ec-1d21031e1d15', '1836c245-48c4-41b2-b730-7ea144e8cb4d', '4240c8cd-89a7-461e-b613-46239d0cabf3', '248c2b2c-238c-4d28-9770-ce176351e9b8'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:55:29 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:55:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] Flow 'volume_create_manager' (30584e2a-eaff-40d2-bd7d-3f08c70e9b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:55:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75a71431-3926-4530-b296-190fd5c87026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75a71431-3926-4530-b296-190fd5c87026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-959662461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35fe1f25-7eda-4719-874f-de33902a7acb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b44208f39e4039a3b4756cbd7be8d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:55:29Z,use_quota=True,user_id='badc7fd858744c898cba471c80b00004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f5258e-9455-4d62-8c89-29fa8f3e9283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f5258e-9455-4d62-8c89-29fa8f3e9283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ec3371-21e0-49a9-8bbf-e21627db0b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ec3371-21e0-49a9-8bbf-e21627db0b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35fe1f25-7eda-4719-874f-de33902a7acb', 'volume_name': 'volume-35fe1f25-7eda-4719-874f-de33902a7acb', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b85c4e-e97b-4b99-922f-13dbe5aea624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b85c4e-e97b-4b99-922f-13dbe5aea624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc42b782-d9e7-4882-87a3-534ef53d0d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:29 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] Volume 35fe1f25-7eda-4719-874f-de33902a7acb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35fe1f25-7eda-4719-874f-de33902a7acb', 'volume_size': 1} Apr 25 15:55:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:55:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:55:29 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-959662461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35fe1f25-7eda-4719-874f-de33902a7acb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b44208f39e4039a3b4756cbd7be8d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:55:29Z,use_quota=True,user_id='badc7fd858744c898cba471c80b00004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:55:29 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] Creating volume 35fe1f25-7eda-4719-874f-de33902a7acb {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:55:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:55:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:55:29 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:55:29 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:55:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:55:29 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:55:29 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:55:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-35fe1f25-7eda-4719-874f-de33902a7acb 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:29 devstack sudo[89144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-35fe1f25-7eda-4719-874f-de33902a7acb 1073741824 Apr 25 15:55:29 devstack sudo[89144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-735974fa-5c66-480e-8f2a-ad140fdc3315 tempest-VolumeDependencyTests-1092498908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:55:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-735974fa-5c66-480e-8f2a-ad140fdc3315 tempest-VolumeDependencyTests-1092498908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:55:29 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-735974fa-5c66-480e-8f2a-ad140fdc3315 tempest-VolumeDependencyTests-1092498908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:55:29 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-735974fa-5c66-480e-8f2a-ad140fdc3315 tempest-VolumeDependencyTests-1092498908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:55:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-735974fa-5c66-480e-8f2a-ad140fdc3315 tempest-VolumeDependencyTests-1092498908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:55:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-735974fa-5c66-480e-8f2a-ad140fdc3315 tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:29 devstack sudo[89146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:55:29 devstack sudo[89146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:29 devstack sudo[89146]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-735974fa-5c66-480e-8f2a-ad140fdc3315 tempest-VolumeDependencyTests-1092498908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.515s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:29 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-735974fa-5c66-480e-8f2a-ad140fdc3315 tempest-VolumeDependencyTests-1092498908 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:55:29 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-735974fa-5c66-480e-8f2a-ad140fdc3315 tempest-VolumeDependencyTests-1092498908 None] Deleted volume successfully. Apr 25 15:55:29 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-735974fa-5c66-480e-8f2a-ad140fdc3315 tempest-VolumeDependencyTests-1092498908 None] Lock "cinder-c02318ff-5964-44ba-b91c-68c850013a36-delete_volume" released by "delete_volume" :: held 2.182s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:55:29 devstack sudo[89144]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-35fe1f25-7eda-4719-874f-de33902a7acb 1073741824" returned: 0 in 0.758s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-35fe1f25-7eda-4719-874f-de33902a7acb {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:29 devstack sudo[89158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-35fe1f25-7eda-4719-874f-de33902a7acb Apr 25 15:55:29 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:30 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:55:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] Flow 'volume_create_manager' (0b67d8a2-ea08-45e8-8561-5f7cec48f402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:55:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24dd52c7-3627-490b-82d4-e49cf7669132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24dd52c7-3627-490b-82d4-e49cf7669132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1857769726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc3bc846-2e86-4068-bfe8-18e43f1810d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76628ec206244af96e2fe85101d3b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:55:30Z,use_quota=True,user_id='b4396b2ce5b04e41bbf861f233aa2e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (481d1537-8285-431f-9d60-da06ed8a0b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (481d1537-8285-431f-9d60-da06ed8a0b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (361af2dd-05ca-4bd1-b62c-5e6532f5a923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (361af2dd-05ca-4bd1-b62c-5e6532f5a923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc3bc846-2e86-4068-bfe8-18e43f1810d2', 'volume_name': 'volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a0fefe6-9765-4401-8830-27011146ced8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a0fefe6-9765-4401-8830-27011146ced8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b791c441-b80b-489d-833d-34c9923d1c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:30 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] Volume fc3bc846-2e86-4068-bfe8-18e43f1810d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2', 'volume_size': 1} Apr 25 15:55:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:55:30 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-35fe1f25-7eda-4719-874f-de33902a7acb" returned: 0 in 0.555s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] <== create_volume: return (1395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:55:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:55:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.192s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:55:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1857769726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc3bc846-2e86-4068-bfe8-18e43f1810d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76628ec206244af96e2fe85101d3b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:55:30Z,use_quota=True,user_id='b4396b2ce5b04e41bbf861f233aa2e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:55:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] Creating volume fc3bc846-2e86-4068-bfe8-18e43f1810d2 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:55:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:55:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:55:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:55:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:55:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:55:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:55:30 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:55:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:30 devstack sudo[89162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2 1073741824 Apr 25 15:55:30 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc42b782-d9e7-4882-87a3-534ef53d0d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35fe1f25-7eda-4719-874f-de33902a7acb', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c53e0d0d-61d3-4b3e-9b27-94cf8c1cf1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:30 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] Volume volume-35fe1f25-7eda-4719-874f-de33902a7acb (35fe1f25-7eda-4719-874f-de33902a7acb): created successfully Apr 25 15:55:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c53e0d0d-61d3-4b3e-9b27-94cf8c1cf1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] Flow 'volume_create_manager' (30584e2a-eaff-40d2-bd7d-3f08c70e9b18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:55:30 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-d40ac1ca-ccfc-4a66-9cc8-e3ab7b67163b tempest-VolumesActionsTest-955970035 None] Created volume successfully. Apr 25 15:55:31 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d1166cf0-b383-4261-a16e-c980e2fb5c08 tempest-VolumesActionsTest-955970035 None] Acquiring lock "cinder-35fe1f25-7eda-4719-874f-de33902a7acb" by "attach_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:55:31 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2 1073741824" returned: 0 in 0.652s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:31 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d1166cf0-b383-4261-a16e-c980e2fb5c08 tempest-VolumesActionsTest-955970035 None] Lock "cinder-35fe1f25-7eda-4719-874f-de33902a7acb" acquired by "attach_volume" :: waited 0.034s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:55:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:31 devstack sudo[89167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2 Apr 25 15:55:31 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:31 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-d1166cf0-b383-4261-a16e-c980e2fb5c08 tempest-VolumesActionsTest-955970035 None] Attaching volume 35fe1f25-7eda-4719-874f-de33902a7acb to instance 5629c274-f267-4371-90ad-34f8c3500823 at mountpoint /dev/vdb on host None. Apr 25 15:55:31 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-d1166cf0-b383-4261-a16e-c980e2fb5c08 tempest-VolumesActionsTest-955970035 None] Attach volume completed successfully. Apr 25 15:55:31 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d1166cf0-b383-4261-a16e-c980e2fb5c08 tempest-VolumesActionsTest-955970035 None] Lock "cinder-35fe1f25-7eda-4719-874f-de33902a7acb" released by "attach_volume" :: held 0.174s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:55:31 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2" returned: 0 in 0.483s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:31 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:55:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:55:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b791c441-b80b-489d-833d-34c9923d1c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c1eac79-6c10-47fd-8157-4fa953b1ded9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:31 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] Volume volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2 (fc3bc846-2e86-4068-bfe8-18e43f1810d2): created successfully Apr 25 15:55:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c1eac79-6c10-47fd-8157-4fa953b1ded9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] Flow 'volume_create_manager' (0b67d8a2-ea08-45e8-8561-5f7cec48f402) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:55:31 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-4ffeb0e9-1d6d-4c25-be08-afff2a15d608 tempest-VolumeDependencyTests-1092498908 None] Created volume successfully. Apr 25 15:55:32 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-13d521c5-37b1-4333-934b-88b2e465fcb2 tempest-VolumesActionsTest-980582526 None] Terminate volume connection completed successfully. Apr 25 15:55:32 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-13d521c5-37b1-4333-934b-88b2e465fcb2 tempest-VolumesActionsTest-980582526 None] Acquiring lock "cinder-35fe1f25-7eda-4719-874f-de33902a7acb-detach_volume" by "detach_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:55:32 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-13d521c5-37b1-4333-934b-88b2e465fcb2 tempest-VolumesActionsTest-980582526 None] Lock "cinder-35fe1f25-7eda-4719-874f-de33902a7acb-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:55:32 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-13d521c5-37b1-4333-934b-88b2e465fcb2 tempest-VolumesActionsTest-980582526 None] Detaching volume 35fe1f25-7eda-4719-874f-de33902a7acb from instance 5629c274-f267-4371-90ad-34f8c3500823. Apr 25 15:55:32 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-13d521c5-37b1-4333-934b-88b2e465fcb2 tempest-VolumesActionsTest-980582526 None] Detach volume completed successfully. Apr 25 15:55:32 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-13d521c5-37b1-4333-934b-88b2e465fcb2 tempest-VolumesActionsTest-980582526 None] Lock "cinder-35fe1f25-7eda-4719-874f-de33902a7acb-detach_volume" released by "detach_volume" :: held 0.083s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:55:32 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:55:32 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Flow 'volume_create_manager' (ecba4107-046c-486d-9feb-b5ce25dcc768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:55:32 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16256b01-c8a9-459f-860e-3bcf2fe7b143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:32 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16256b01-c8a9-459f-860e-3bcf2fe7b143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:55:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1535884375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b857cf66-eeef-41fd-be5b-94b292862990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f76628ec206244af96e2fe85101d3b28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:55:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=fc3bc846-2e86-4068-bfe8-18e43f1810d2,status='creating',terminated_at=None,updated_at=2026-04-25T13:55:33Z,use_quota=True,user_id='b4396b2ce5b04e41bbf861f233aa2e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:32 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6564c9ff-e0e2-486c-a512-3ace77e407b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:32 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6564c9ff-e0e2-486c-a512-3ace77e407b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:32 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac4a61a1-f91d-464c-8ccb-9f7e2bd8ec87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:32 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac4a61a1-f91d-464c-8ccb-9f7e2bd8ec87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b857cf66-eeef-41fd-be5b-94b292862990', 'volume_name': 'volume-b857cf66-eeef-41fd-be5b-94b292862990', 'volume_size': 1, 'source_volid': 'fc3bc846-2e86-4068-bfe8-18e43f1810d2', 'source_volstatus': 'available'}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:32 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b67558d-a116-4520-95f9-fd4b323c4a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:32 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b67558d-a116-4520-95f9-fd4b323c4a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:32 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04fc4d25-a9c7-4422-9a1a-6bb15539a884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:32 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Volume b857cf66-eeef-41fd-be5b-94b292862990: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b857cf66-eeef-41fd-be5b-94b292862990', 'volume_size': 1, 'source_volid': 'fc3bc846-2e86-4068-bfe8-18e43f1810d2', 'source_volstatus': 'available'} Apr 25 15:55:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:55:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:55:32 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Cloning volume fc3bc846-2e86-4068-bfe8-18e43f1810d2 to volume b857cf66-eeef-41fd-be5b-94b292862990 Apr 25 15:55:32 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Creating offline snapshot cd78b664-afbb-4e00-8a15-642618064cef of volume fc3bc846-2e86-4068-bfe8-18e43f1810d2 {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 15:55:32 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[060af2eb-b723-49e0-833d-b58063dd6eb2]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:55:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:33 devstack sudo[89171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2 Apr 25 15:55:33 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:33 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a0757ba6-9aea-42c5-8a57-ffe46ac37b62 tempest-VolumesActionsTest-955970035 None] Acquiring lock "cinder-35fe1f25-7eda-4719-874f-de33902a7acb-detach_volume" by "detach_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:55:33 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a0757ba6-9aea-42c5-8a57-ffe46ac37b62 tempest-VolumesActionsTest-955970035 None] Lock "cinder-35fe1f25-7eda-4719-874f-de33902a7acb-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:55:33 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-a0757ba6-9aea-42c5-8a57-ffe46ac37b62 tempest-VolumesActionsTest-955970035 None] Volume detach called, but volume not attached. Apr 25 15:55:33 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a0757ba6-9aea-42c5-8a57-ffe46ac37b62 tempest-VolumesActionsTest-955970035 None] Lock "cinder-35fe1f25-7eda-4719-874f-de33902a7acb-detach_volume" released by "detach_volume" :: held 0.036s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:55:33 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2" returned: 0 in 0.551s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2.cd78b664-afbb-4e00-8a15-642618064cef 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:33 devstack sudo[89176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2.cd78b664-afbb-4e00-8a15-642618064cef 1G Apr 25 15:55:33 devstack sudo[89176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:33 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fe6dd2fb-4fcf-4b0a-b0e3-5d6ffb561949 tempest-VolumesActionsTest-955970035 None] Acquiring lock "cinder-35fe1f25-7eda-4719-874f-de33902a7acb-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:55:34 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fe6dd2fb-4fcf-4b0a-b0e3-5d6ffb561949 tempest-VolumesActionsTest-955970035 None] Lock "cinder-35fe1f25-7eda-4719-874f-de33902a7acb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:55:34 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fe6dd2fb-4fcf-4b0a-b0e3-5d6ffb561949 tempest-VolumesActionsTest-955970035 None] Acquiring lock "cinder-quobyte-35fe1f25-7eda-4719-874f-de33902a7acb" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:55:34 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fe6dd2fb-4fcf-4b0a-b0e3-5d6ffb561949 tempest-VolumesActionsTest-955970035 None] Lock "cinder-quobyte-35fe1f25-7eda-4719-874f-de33902a7acb" acquired by "delete_volume" :: waited 0.016s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:55:34 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[4623f5a3-d31e-4a5a-bd0a-48e6584a30c3]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:55:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fe6dd2fb-4fcf-4b0a-b0e3-5d6ffb561949 tempest-VolumesActionsTest-955970035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-35fe1f25-7eda-4719-874f-de33902a7acb {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:34 devstack sudo[89176]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2.cd78b664-afbb-4e00-8a15-642618064cef 1G" returned: 0 in 0.682s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2.cd78b664-afbb-4e00-8a15-642618064cef {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:34 devstack sudo[89182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2.cd78b664-afbb-4e00-8a15-642618064cef Apr 25 15:55:34 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:34 devstack sudo[89181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-35fe1f25-7eda-4719-874f-de33902a7acb Apr 25 15:55:34 devstack sudo[89181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:34 devstack sudo[89181]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fe6dd2fb-4fcf-4b0a-b0e3-5d6ffb561949 tempest-VolumesActionsTest-955970035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-35fe1f25-7eda-4719-874f-de33902a7acb" returned: 0 in 0.594s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fe6dd2fb-4fcf-4b0a-b0e3-5d6ffb561949 tempest-VolumesActionsTest-955970035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-35fe1f25-7eda-4719-874f-de33902a7acb {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:34 devstack sudo[89191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-35fe1f25-7eda-4719-874f-de33902a7acb Apr 25 15:55:34 devstack sudo[89191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:34 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2.cd78b664-afbb-4e00-8a15-642618064cef" returned: 0 in 0.559s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:34 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2.cd78b664-afbb-4e00-8a15-642618064cef is being set with open permissions: ugo+rw Apr 25 15:55:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2.cd78b664-afbb-4e00-8a15-642618064cef {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:34 devstack sudo[89193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2.cd78b664-afbb-4e00-8a15-642618064cef Apr 25 15:55:34 devstack sudo[89193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:35 devstack sudo[89193]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2.cd78b664-afbb-4e00-8a15-642618064cef" returned: 0 in 0.470s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:35 devstack sudo[89191]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fe6dd2fb-4fcf-4b0a-b0e3-5d6ffb561949 tempest-VolumesActionsTest-955970035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-35fe1f25-7eda-4719-874f-de33902a7acb" returned: 0 in 0.553s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:35 devstack sudo[89197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2.info Apr 25 15:55:35 devstack sudo[89197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:35 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fe6dd2fb-4fcf-4b0a-b0e3-5d6ffb561949 tempest-VolumesActionsTest-955970035 None] Lock "cinder-quobyte-35fe1f25-7eda-4719-874f-de33902a7acb" released by "delete_volume" :: held 1.211s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:55:35 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-fe6dd2fb-4fcf-4b0a-b0e3-5d6ffb561949 tempest-VolumesActionsTest-955970035 None] Created reservations ['d5c56659-7c4a-4bbd-a154-16f69ad03dc3', 'd6db52b3-15bb-4d99-81e3-dcc7b7f3b28e', '76f0945b-ab57-4629-ae78-5dea747e4871', 'e8e57e25-a27f-4c9c-a45d-759478fda137'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:55:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fe6dd2fb-4fcf-4b0a-b0e3-5d6ffb561949 tempest-VolumesActionsTest-955970035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:55:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fe6dd2fb-4fcf-4b0a-b0e3-5d6ffb561949 tempest-VolumesActionsTest-955970035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:55:35 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-fe6dd2fb-4fcf-4b0a-b0e3-5d6ffb561949 tempest-VolumesActionsTest-955970035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:55:35 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-fe6dd2fb-4fcf-4b0a-b0e3-5d6ffb561949 tempest-VolumesActionsTest-955970035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:55:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fe6dd2fb-4fcf-4b0a-b0e3-5d6ffb561949 tempest-VolumesActionsTest-955970035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:55:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fe6dd2fb-4fcf-4b0a-b0e3-5d6ffb561949 tempest-VolumesActionsTest-955970035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:35 devstack sudo[89199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:55:35 devstack sudo[89199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:35 devstack sudo[89197]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2.info" returned: 0 in 0.440s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:35 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2.info is being set with open permissions: ugo+rw Apr 25 15:55:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:35 devstack sudo[89202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2.info Apr 25 15:55:35 devstack sudo[89202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:35 devstack sudo[89199]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fe6dd2fb-4fcf-4b0a-b0e3-5d6ffb561949 tempest-VolumesActionsTest-955970035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.457s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:35 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-fe6dd2fb-4fcf-4b0a-b0e3-5d6ffb561949 tempest-VolumesActionsTest-955970035 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:55:35 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-fe6dd2fb-4fcf-4b0a-b0e3-5d6ffb561949 tempest-VolumesActionsTest-955970035 None] Deleted volume successfully. Apr 25 15:55:35 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fe6dd2fb-4fcf-4b0a-b0e3-5d6ffb561949 tempest-VolumesActionsTest-955970035 None] Lock "cinder-35fe1f25-7eda-4719-874f-de33902a7acb-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:55:36 devstack sudo[89202]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2.info" returned: 0 in 0.413s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:36 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Acquiring lock "cinder-quobyte-b857cf66-eeef-41fd-be5b-94b292862990" by "_copy_volume_from_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:55:36 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Lock "cinder-quobyte-b857cf66-eeef-41fd-be5b-94b292862990" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:55:36 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] snapshot: cd78b664-afbb-4e00-8a15-642618064cef, volume: b857cf66-eeef-41fd-be5b-94b292862990, {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 25 15:55:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:55:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:55:36 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:55:36 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:55:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:55:36 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbb12c8-10dc-4992-b0dc-1471a4e522f8]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:55:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2.cd78b664-afbb-4e00-8a15-642618064cef {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:36 devstack sudo[89206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2.cd78b664-afbb-4e00-8a15-642618064cef Apr 25 15:55:36 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:36 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2.cd78b664-afbb-4e00-8a15-642618064cef" returned: 0 in 0.591s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:36 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:55:36 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] will copy from snapshot at /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2 {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 25 15:55:36 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Creating direct copy from snapshot {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 25 15:55:36 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7d821a-d49f-4326-aab9-d6074a65c4dd]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:55:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:36 devstack sudo[89212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2 Apr 25 15:55:36 devstack sudo[89212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:37 devstack sudo[89212]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2" returned: 0 in 0.580s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:37 devstack cinder-volume[81828]: DEBUG cinder.utils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Path /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b857cf66-eeef-41fd-be5b-94b292862990 not found in is_blk_device check {{(pid=81828) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 25 15:55:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b857cf66-eeef-41fd-be5b-94b292862990 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:37 devstack sudo[89225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b857cf66-eeef-41fd-be5b-94b292862990 Apr 25 15:55:37 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:42 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b857cf66-eeef-41fd-be5b-94b292862990" returned: 0 in 5.108s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:42 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd593351-2824-4f45-83b4-9c3820c7e1de]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:55:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:42 devstack sudo[89260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2 Apr 25 15:55:42 devstack sudo[89260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:43 devstack sudo[89260]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2" returned: 0 in 0.658s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:43 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Image conversion details: src /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2, size 1024.00 MB, duration 5.11 sec, destination /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b857cf66-eeef-41fd-be5b-94b292862990 {{(pid=81828) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 15:55:43 devstack cinder-volume[81828]: INFO cinder.image.image_utils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Converted 1024.00 MB image at 200.38 MB/s Apr 25 15:55:43 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b857cf66-eeef-41fd-be5b-94b292862990 is being set with open permissions: ugo+rw Apr 25 15:55:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b857cf66-eeef-41fd-be5b-94b292862990 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:43 devstack sudo[89265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b857cf66-eeef-41fd-be5b-94b292862990 Apr 25 15:55:43 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:43 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:55:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] Flow 'volume_create_manager' (169f48c6-135c-4c0b-b75e-2ef3ac1d517e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:55:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04a6c29-78b5-4440-ae7d-bd63b7ccec2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04a6c29-78b5-4440-ae7d-bd63b7ccec2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1208841857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eda68bf-102a-41d1-adaf-916dd71a75a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b44208f39e4039a3b4756cbd7be8d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:55:43Z,use_quota=True,user_id='badc7fd858744c898cba471c80b00004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (947daf89-a4f5-4fff-aca5-38d4bf350e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (947daf89-a4f5-4fff-aca5-38d4bf350e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f1dde6e-411e-406f-994d-c8c723fdc88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f1dde6e-411e-406f-994d-c8c723fdc88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8eda68bf-102a-41d1-adaf-916dd71a75a0', 'volume_name': 'volume-8eda68bf-102a-41d1-adaf-916dd71a75a0', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa22f8bf-461c-4d3b-b230-69cf13876c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa22f8bf-461c-4d3b-b230-69cf13876c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e569f2-4ed7-467c-b93b-88353774b3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:43 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] Volume 8eda68bf-102a-41d1-adaf-916dd71a75a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8eda68bf-102a-41d1-adaf-916dd71a75a0', 'volume_size': 1} Apr 25 15:55:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:55:43 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b857cf66-eeef-41fd-be5b-94b292862990" returned: 0 in 0.471s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Lock "cinder-quobyte-b857cf66-eeef-41fd-be5b-94b292862990" released by "_copy_volume_from_snapshot" :: held 7.506s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:55:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Acquiring lock "cinder-quobyte-cd78b664-afbb-4e00-8a15-642618064cef" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:55:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Lock "cinder-quobyte-cd78b664-afbb-4e00-8a15-642618064cef" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:55:43 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Deleting offline snapshot cd78b664-afbb-4e00-8a15-642618064cef of volume fc3bc846-2e86-4068-bfe8-18e43f1810d2 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 15:55:43 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] snapshot_file for this snap is: volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2.cd78b664-afbb-4e00-8a15-642618064cef {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 15:55:43 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1fc068-6dce-4d15-b052-af3fcd11162a]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:55:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2.cd78b664-afbb-4e00-8a15-642618064cef {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:43 devstack sudo[89270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2.cd78b664-afbb-4e00-8a15-642618064cef Apr 25 15:55:43 devstack sudo[89270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:44 devstack sudo[89270]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2.cd78b664-afbb-4e00-8a15-642618064cef" returned: 0 in 0.503s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:55:44 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc69a663-4886-4742-8880-bcdac2a4f332]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:55:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:44 devstack sudo[89275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2 Apr 25 15:55:44 devstack sudo[89275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:44 devstack sudo[89275]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2" returned: 0 in 0.525s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2.cd78b664-afbb-4e00-8a15-642618064cef {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:44 devstack sudo[89280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2.cd78b664-afbb-4e00-8a15-642618064cef Apr 25 15:55:44 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:45 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2.cd78b664-afbb-4e00-8a15-642618064cef" returned: 0 in 0.522s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2.cd78b664-afbb-4e00-8a15-642618064cef {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:45 devstack sudo[89285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2.cd78b664-afbb-4e00-8a15-642618064cef Apr 25 15:55:45 devstack sudo[89285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:45 devstack sudo[89285]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2.cd78b664-afbb-4e00-8a15-642618064cef" returned: 0 in 0.459s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:45 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Lock "cinder-quobyte-cd78b664-afbb-4e00-8a15-642618064cef" released by "_delete_snapshot" :: held 2.092s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:55:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.900s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:55:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.200s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:55:45 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1208841857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8eda68bf-102a-41d1-adaf-916dd71a75a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b44208f39e4039a3b4756cbd7be8d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:55:43Z,use_quota=True,user_id='badc7fd858744c898cba471c80b00004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:55:45 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] Creating volume 8eda68bf-102a-41d1-adaf-916dd71a75a0 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:55:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:55:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:55:45 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:55:45 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:55:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:55:45 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:55:45 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:55:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8eda68bf-102a-41d1-adaf-916dd71a75a0 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:45 devstack sudo[89288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8eda68bf-102a-41d1-adaf-916dd71a75a0 1073741824 Apr 25 15:55:45 devstack sudo[89288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04fc4d25-a9c7-4422-9a1a-6bb15539a884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b857cf66-eeef-41fd-be5b-94b292862990', 'volume_size': 1, 'source_volid': 'fc3bc846-2e86-4068-bfe8-18e43f1810d2', 'source_volstatus': 'available'}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e566f3-8154-436e-81b6-4c3102620dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:45 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Volume volume-b857cf66-eeef-41fd-be5b-94b292862990 (b857cf66-eeef-41fd-be5b-94b292862990): created successfully Apr 25 15:55:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e566f3-8154-436e-81b6-4c3102620dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Flow 'volume_create_manager' (ecba4107-046c-486d-9feb-b5ce25dcc768) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:55:45 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-22e9d8ee-41f5-47c5-ac7f-178369bbf3a7 tempest-VolumeDependencyTests-1092498908 None] Created volume successfully. Apr 25 15:55:46 devstack sudo[89288]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8eda68bf-102a-41d1-adaf-916dd71a75a0 1073741824" returned: 0 in 0.588s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8eda68bf-102a-41d1-adaf-916dd71a75a0 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:46 devstack sudo[89293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8eda68bf-102a-41d1-adaf-916dd71a75a0 Apr 25 15:55:46 devstack sudo[89293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:46 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-bdc27b8d-4495-4409-a527-4689c9a5092d tempest-VolumeDependencyTests-1092498908 None] Acquiring lock "cinder-fc3bc846-2e86-4068-bfe8-18e43f1810d2-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:55:46 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-bdc27b8d-4495-4409-a527-4689c9a5092d tempest-VolumeDependencyTests-1092498908 None] Lock "cinder-fc3bc846-2e86-4068-bfe8-18e43f1810d2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:55:46 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-bdc27b8d-4495-4409-a527-4689c9a5092d tempest-VolumeDependencyTests-1092498908 None] Acquiring lock "cinder-quobyte-fc3bc846-2e86-4068-bfe8-18e43f1810d2" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:55:46 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-bdc27b8d-4495-4409-a527-4689c9a5092d tempest-VolumeDependencyTests-1092498908 None] Lock "cinder-quobyte-fc3bc846-2e86-4068-bfe8-18e43f1810d2" acquired by "delete_volume" :: waited 0.014s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:55:46 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[f603f5ba-9d5a-403f-9453-2ed4c3f7fd3b]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:55:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bdc27b8d-4495-4409-a527-4689c9a5092d tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:46 devstack sudo[89293]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8eda68bf-102a-41d1-adaf-916dd71a75a0" returned: 0 in 0.486s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:46 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:55:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:55:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e569f2-4ed7-467c-b93b-88353774b3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8eda68bf-102a-41d1-adaf-916dd71a75a0', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef97d99-0949-470d-bb13-0ee3310694de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:46 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] Volume volume-8eda68bf-102a-41d1-adaf-916dd71a75a0 (8eda68bf-102a-41d1-adaf-916dd71a75a0): created successfully Apr 25 15:55:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ef97d99-0949-470d-bb13-0ee3310694de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] Flow 'volume_create_manager' (169f48c6-135c-4c0b-b75e-2ef3ac1d517e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:55:46 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-c3b27b68-170b-410c-9b07-c1c6a55f7e5e tempest-VolumesActionsTest-955970035 None] Created volume successfully. Apr 25 15:55:46 devstack sudo[89296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2 Apr 25 15:55:47 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:47 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bdc27b8d-4495-4409-a527-4689c9a5092d tempest-VolumeDependencyTests-1092498908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2" returned: 0 in 0.532s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bdc27b8d-4495-4409-a527-4689c9a5092d tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:47 devstack sudo[89301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2 Apr 25 15:55:47 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:47 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:47 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3fd21278-2c0d-4737-b252-8a842aa17dd8 tempest-VolumesActionsTest-980582526 None] Acquiring lock "cinder-8eda68bf-102a-41d1-adaf-916dd71a75a0-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:55:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bdc27b8d-4495-4409-a527-4689c9a5092d tempest-VolumeDependencyTests-1092498908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-fc3bc846-2e86-4068-bfe8-18e43f1810d2" returned: 0 in 0.457s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:47 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-bdc27b8d-4495-4409-a527-4689c9a5092d tempest-VolumeDependencyTests-1092498908 None] Lock "cinder-quobyte-fc3bc846-2e86-4068-bfe8-18e43f1810d2" released by "delete_volume" :: held 1.046s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:55:47 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3fd21278-2c0d-4737-b252-8a842aa17dd8 tempest-VolumesActionsTest-980582526 None] Lock "cinder-8eda68bf-102a-41d1-adaf-916dd71a75a0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:55:47 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3fd21278-2c0d-4737-b252-8a842aa17dd8 tempest-VolumesActionsTest-980582526 None] Acquiring lock "cinder-quobyte-8eda68bf-102a-41d1-adaf-916dd71a75a0" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:55:48 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3fd21278-2c0d-4737-b252-8a842aa17dd8 tempest-VolumesActionsTest-980582526 None] Lock "cinder-quobyte-8eda68bf-102a-41d1-adaf-916dd71a75a0" acquired by "delete_volume" :: waited 0.021s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:55:48 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-bdc27b8d-4495-4409-a527-4689c9a5092d tempest-VolumeDependencyTests-1092498908 None] Created reservations ['6b427c2f-9dc9-47f1-8ad9-d61c28c37c04', '2afaff36-14b6-407e-8d69-9c849413136d', '80547950-d8d0-459d-b836-c80d1cf61cad', '3b0481e3-5bac-4af4-ae04-ce2ccc1aabc0'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:55:48 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[950bf5ee-c490-4452-bf3e-4b609e3aee26]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:55:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3fd21278-2c0d-4737-b252-8a842aa17dd8 tempest-VolumesActionsTest-980582526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8eda68bf-102a-41d1-adaf-916dd71a75a0 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bdc27b8d-4495-4409-a527-4689c9a5092d tempest-VolumeDependencyTests-1092498908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:55:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bdc27b8d-4495-4409-a527-4689c9a5092d tempest-VolumeDependencyTests-1092498908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:55:48 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-bdc27b8d-4495-4409-a527-4689c9a5092d tempest-VolumeDependencyTests-1092498908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:55:48 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-bdc27b8d-4495-4409-a527-4689c9a5092d tempest-VolumeDependencyTests-1092498908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:55:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bdc27b8d-4495-4409-a527-4689c9a5092d tempest-VolumeDependencyTests-1092498908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:55:48 devstack sudo[89304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8eda68bf-102a-41d1-adaf-916dd71a75a0 Apr 25 15:55:48 devstack sudo[89304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bdc27b8d-4495-4409-a527-4689c9a5092d tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:48 devstack sudo[89306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:55:48 devstack sudo[89306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:48 devstack sudo[89306]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bdc27b8d-4495-4409-a527-4689c9a5092d tempest-VolumeDependencyTests-1092498908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.432s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:48 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-bdc27b8d-4495-4409-a527-4689c9a5092d tempest-VolumeDependencyTests-1092498908 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:55:48 devstack sudo[89304]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:48 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-bdc27b8d-4495-4409-a527-4689c9a5092d tempest-VolumeDependencyTests-1092498908 None] Deleted volume successfully. Apr 25 15:55:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3fd21278-2c0d-4737-b252-8a842aa17dd8 tempest-VolumesActionsTest-980582526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8eda68bf-102a-41d1-adaf-916dd71a75a0" returned: 0 in 0.525s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3fd21278-2c0d-4737-b252-8a842aa17dd8 tempest-VolumesActionsTest-980582526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8eda68bf-102a-41d1-adaf-916dd71a75a0 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:48 devstack sudo[89312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8eda68bf-102a-41d1-adaf-916dd71a75a0 Apr 25 15:55:48 devstack sudo[89312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:48 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-bdc27b8d-4495-4409-a527-4689c9a5092d tempest-VolumeDependencyTests-1092498908 None] Lock "cinder-fc3bc846-2e86-4068-bfe8-18e43f1810d2-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:55:49 devstack sudo[89312]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:49 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-bf0e5cf9-d3db-44f0-af34-12d333b8488c tempest-VolumeDependencyTests-1092498908 None] Acquiring lock "cinder-b857cf66-eeef-41fd-be5b-94b292862990-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:55:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3fd21278-2c0d-4737-b252-8a842aa17dd8 tempest-VolumesActionsTest-980582526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8eda68bf-102a-41d1-adaf-916dd71a75a0" returned: 0 in 0.485s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:49 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3fd21278-2c0d-4737-b252-8a842aa17dd8 tempest-VolumesActionsTest-980582526 None] Lock "cinder-quobyte-8eda68bf-102a-41d1-adaf-916dd71a75a0" released by "delete_volume" :: held 1.052s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:55:49 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-bf0e5cf9-d3db-44f0-af34-12d333b8488c tempest-VolumeDependencyTests-1092498908 None] Lock "cinder-b857cf66-eeef-41fd-be5b-94b292862990-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:55:49 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-bf0e5cf9-d3db-44f0-af34-12d333b8488c tempest-VolumeDependencyTests-1092498908 None] Acquiring lock "cinder-quobyte-b857cf66-eeef-41fd-be5b-94b292862990" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:55:49 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-3fd21278-2c0d-4737-b252-8a842aa17dd8 tempest-VolumesActionsTest-980582526 None] Created reservations ['f0384604-2d26-47ce-bf1f-4d74b57a19b1', '43356d20-414c-4fda-9227-337058ef8803', '0b8bc09c-bf0f-45a4-922d-0418426e9e06', 'ae2cfc7f-f932-41f6-9966-b7dea70d726a'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:55:49 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-bf0e5cf9-d3db-44f0-af34-12d333b8488c tempest-VolumeDependencyTests-1092498908 None] Lock "cinder-quobyte-b857cf66-eeef-41fd-be5b-94b292862990" acquired by "delete_volume" :: waited 0.024s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:55:49 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[80552f06-f8a7-4983-a3da-3406cfe106f4]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:55:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bf0e5cf9-d3db-44f0-af34-12d333b8488c tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b857cf66-eeef-41fd-be5b-94b292862990 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3fd21278-2c0d-4737-b252-8a842aa17dd8 tempest-VolumesActionsTest-980582526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:55:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3fd21278-2c0d-4737-b252-8a842aa17dd8 tempest-VolumesActionsTest-980582526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:55:49 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3fd21278-2c0d-4737-b252-8a842aa17dd8 tempest-VolumesActionsTest-980582526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:55:49 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3fd21278-2c0d-4737-b252-8a842aa17dd8 tempest-VolumesActionsTest-980582526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:55:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3fd21278-2c0d-4737-b252-8a842aa17dd8 tempest-VolumesActionsTest-980582526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:55:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3fd21278-2c0d-4737-b252-8a842aa17dd8 tempest-VolumesActionsTest-980582526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:49 devstack sudo[89315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b857cf66-eeef-41fd-be5b-94b292862990 Apr 25 15:55:49 devstack sudo[89315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:49 devstack sudo[89317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:55:49 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:49 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3fd21278-2c0d-4737-b252-8a842aa17dd8 tempest-VolumesActionsTest-980582526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.438s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:49 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-3fd21278-2c0d-4737-b252-8a842aa17dd8 tempest-VolumesActionsTest-980582526 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:55:49 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-3fd21278-2c0d-4737-b252-8a842aa17dd8 tempest-VolumesActionsTest-980582526 None] Deleted volume successfully. Apr 25 15:55:49 devstack sudo[89315]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:49 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3fd21278-2c0d-4737-b252-8a842aa17dd8 tempest-VolumesActionsTest-980582526 None] Lock "cinder-8eda68bf-102a-41d1-adaf-916dd71a75a0-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:55:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bf0e5cf9-d3db-44f0-af34-12d333b8488c tempest-VolumeDependencyTests-1092498908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b857cf66-eeef-41fd-be5b-94b292862990" returned: 0 in 0.536s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bf0e5cf9-d3db-44f0-af34-12d333b8488c tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b857cf66-eeef-41fd-be5b-94b292862990 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:49 devstack sudo[89323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b857cf66-eeef-41fd-be5b-94b292862990 Apr 25 15:55:49 devstack sudo[89323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:50 devstack sudo[89323]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bf0e5cf9-d3db-44f0-af34-12d333b8488c tempest-VolumeDependencyTests-1092498908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b857cf66-eeef-41fd-be5b-94b292862990" returned: 0 in 0.456s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-bf0e5cf9-d3db-44f0-af34-12d333b8488c tempest-VolumeDependencyTests-1092498908 None] Lock "cinder-quobyte-b857cf66-eeef-41fd-be5b-94b292862990" released by "delete_volume" :: held 1.033s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-bf0e5cf9-d3db-44f0-af34-12d333b8488c tempest-VolumeDependencyTests-1092498908 None] Created reservations ['467280c4-f0aa-4948-8a93-5dc0942f6907', '0872e63f-4cd2-4396-9087-87f0cf9370ba', 'f9fe3e65-024e-4ec5-b530-b915e8ad1455', 'b85f5387-7898-4d02-9a40-38f1979e052d'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bf0e5cf9-d3db-44f0-af34-12d333b8488c tempest-VolumeDependencyTests-1092498908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bf0e5cf9-d3db-44f0-af34-12d333b8488c tempest-VolumeDependencyTests-1092498908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-bf0e5cf9-d3db-44f0-af34-12d333b8488c tempest-VolumeDependencyTests-1092498908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-bf0e5cf9-d3db-44f0-af34-12d333b8488c tempest-VolumeDependencyTests-1092498908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bf0e5cf9-d3db-44f0-af34-12d333b8488c tempest-VolumeDependencyTests-1092498908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bf0e5cf9-d3db-44f0-af34-12d333b8488c tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:50 devstack sudo[89326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:55:50 devstack sudo[89326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] Flow 'volume_create_manager' (9831c76f-b730-43fd-b2da-e4808bad865d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31cae555-1328-4e9f-a2ca-db80b3da8f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31cae555-1328-4e9f-a2ca-db80b3da8f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-482965705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8e498d8-961d-4a08-abd8-239ebd43ec91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b44208f39e4039a3b4756cbd7be8d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:55:50Z,use_quota=True,user_id='badc7fd858744c898cba471c80b00004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7ed9bc0-94f2-49f9-846b-d7aa29ea3c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7ed9bc0-94f2-49f9-846b-d7aa29ea3c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d879c0e3-e553-4b89-9b3a-a99bf51297d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d879c0e3-e553-4b89-9b3a-a99bf51297d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8e498d8-961d-4a08-abd8-239ebd43ec91', 'volume_name': 'volume-d8e498d8-961d-4a08-abd8-239ebd43ec91', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ac0ddb-da49-4266-8fdf-2a381adfed78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ac0ddb-da49-4266-8fdf-2a381adfed78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (672e49cc-5dcf-4699-8995-8ebe86c9810a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:50 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] Volume d8e498d8-961d-4a08-abd8-239ebd43ec91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8e498d8-961d-4a08-abd8-239ebd43ec91', 'volume_size': 1} Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-482965705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8e498d8-961d-4a08-abd8-239ebd43ec91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b44208f39e4039a3b4756cbd7be8d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:55:50Z,use_quota=True,user_id='badc7fd858744c898cba471c80b00004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] Creating volume d8e498d8-961d-4a08-abd8-239ebd43ec91 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:55:50 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d8e498d8-961d-4a08-abd8-239ebd43ec91 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:50 devstack sudo[89328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d8e498d8-961d-4a08-abd8-239ebd43ec91 1073741824 Apr 25 15:55:50 devstack sudo[89328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:50 devstack sudo[89326]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bf0e5cf9-d3db-44f0-af34-12d333b8488c tempest-VolumeDependencyTests-1092498908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.447s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-bf0e5cf9-d3db-44f0-af34-12d333b8488c tempest-VolumeDependencyTests-1092498908 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:55:50 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-bf0e5cf9-d3db-44f0-af34-12d333b8488c tempest-VolumeDependencyTests-1092498908 None] Deleted volume successfully. Apr 25 15:55:50 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-bf0e5cf9-d3db-44f0-af34-12d333b8488c tempest-VolumeDependencyTests-1092498908 None] Lock "cinder-b857cf66-eeef-41fd-be5b-94b292862990-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:55:51 devstack sudo[89328]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d8e498d8-961d-4a08-abd8-239ebd43ec91 1073741824" returned: 0 in 0.602s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d8e498d8-961d-4a08-abd8-239ebd43ec91 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:51 devstack sudo[89340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d8e498d8-961d-4a08-abd8-239ebd43ec91 Apr 25 15:55:51 devstack sudo[89340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:51 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a8fa6480-169e-4edc-9eb7-465110b12bfb tempest-VolumeDependencyTests-1092498908 None] Acquiring lock "cinder-afa65097-a3fa-43e3-b538-2fdc13438897-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:55:51 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a8fa6480-169e-4edc-9eb7-465110b12bfb tempest-VolumeDependencyTests-1092498908 None] Lock "cinder-afa65097-a3fa-43e3-b538-2fdc13438897-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:55:51 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a8fa6480-169e-4edc-9eb7-465110b12bfb tempest-VolumeDependencyTests-1092498908 None] Acquiring lock "cinder-quobyte-afa65097-a3fa-43e3-b538-2fdc13438897" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:55:51 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a8fa6480-169e-4edc-9eb7-465110b12bfb tempest-VolumeDependencyTests-1092498908 None] Lock "cinder-quobyte-afa65097-a3fa-43e3-b538-2fdc13438897" acquired by "delete_volume" :: waited 0.016s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:55:51 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c61221-6dae-4fdd-aa45-9b634a757334]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:55:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a8fa6480-169e-4edc-9eb7-465110b12bfb tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-afa65097-a3fa-43e3-b538-2fdc13438897 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:51 devstack sudo[89343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-afa65097-a3fa-43e3-b538-2fdc13438897 Apr 25 15:55:51 devstack sudo[89343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:51 devstack sudo[89340]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d8e498d8-961d-4a08-abd8-239ebd43ec91" returned: 0 in 0.477s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:51 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:55:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:55:51 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (672e49cc-5dcf-4699-8995-8ebe86c9810a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8e498d8-961d-4a08-abd8-239ebd43ec91', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:51 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9270d57-e3ed-4039-bf86-21e09f292fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:51 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] Volume volume-d8e498d8-961d-4a08-abd8-239ebd43ec91 (d8e498d8-961d-4a08-abd8-239ebd43ec91): created successfully Apr 25 15:55:51 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9270d57-e3ed-4039-bf86-21e09f292fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:51 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] Flow 'volume_create_manager' (9831c76f-b730-43fd-b2da-e4808bad865d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:55:51 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-80937796-a00a-4c63-959b-13e651501c1c tempest-VolumesActionsTest-955970035 None] Created volume successfully. Apr 25 15:55:51 devstack sudo[89343]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a8fa6480-169e-4edc-9eb7-465110b12bfb tempest-VolumeDependencyTests-1092498908 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-afa65097-a3fa-43e3-b538-2fdc13438897" returned: 0 in 0.526s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a8fa6480-169e-4edc-9eb7-465110b12bfb tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-afa65097-a3fa-43e3-b538-2fdc13438897 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:51 devstack sudo[89349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-afa65097-a3fa-43e3-b538-2fdc13438897 Apr 25 15:55:51 devstack sudo[89349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:52 devstack sudo[89349]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a8fa6480-169e-4edc-9eb7-465110b12bfb tempest-VolumeDependencyTests-1092498908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-afa65097-a3fa-43e3-b538-2fdc13438897" returned: 0 in 0.436s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:52 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a8fa6480-169e-4edc-9eb7-465110b12bfb tempest-VolumeDependencyTests-1092498908 None] Lock "cinder-quobyte-afa65097-a3fa-43e3-b538-2fdc13438897" released by "delete_volume" :: held 1.000s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:55:52 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-a8fa6480-169e-4edc-9eb7-465110b12bfb tempest-VolumeDependencyTests-1092498908 None] Created reservations ['34934aff-0d22-4b98-9d54-a43a6611a788', 'c75409e7-b935-4f7d-9e28-e5019f68e941', '8ad69695-1030-40b0-be3c-1b3ec2ed311e', '7488e3e9-f776-4fe0-83bb-df7e677d79c7'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:55:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-a8fa6480-169e-4edc-9eb7-465110b12bfb tempest-VolumeDependencyTests-1092498908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:55:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-a8fa6480-169e-4edc-9eb7-465110b12bfb tempest-VolumeDependencyTests-1092498908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:55:52 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-a8fa6480-169e-4edc-9eb7-465110b12bfb tempest-VolumeDependencyTests-1092498908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:55:52 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-a8fa6480-169e-4edc-9eb7-465110b12bfb tempest-VolumeDependencyTests-1092498908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:55:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-a8fa6480-169e-4edc-9eb7-465110b12bfb tempest-VolumeDependencyTests-1092498908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:55:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a8fa6480-169e-4edc-9eb7-465110b12bfb tempest-VolumeDependencyTests-1092498908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:52 devstack sudo[89352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:55:52 devstack sudo[89352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:52 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e3d83e26-ea15-465b-a51b-bb37160f485f tempest-VolumesActionsTest-980582526 None] Acquiring lock "cinder-d8e498d8-961d-4a08-abd8-239ebd43ec91-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:55:52 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e3d83e26-ea15-465b-a51b-bb37160f485f tempest-VolumesActionsTest-980582526 None] Lock "cinder-d8e498d8-961d-4a08-abd8-239ebd43ec91-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:55:52 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e3d83e26-ea15-465b-a51b-bb37160f485f tempest-VolumesActionsTest-980582526 None] Acquiring lock "cinder-quobyte-d8e498d8-961d-4a08-abd8-239ebd43ec91" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:55:52 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e3d83e26-ea15-465b-a51b-bb37160f485f tempest-VolumesActionsTest-980582526 None] Lock "cinder-quobyte-d8e498d8-961d-4a08-abd8-239ebd43ec91" acquired by "delete_volume" :: waited 0.016s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:55:52 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e702a1-b97d-4c4c-a01f-2cab31e2af7d]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:55:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e3d83e26-ea15-465b-a51b-bb37160f485f tempest-VolumesActionsTest-980582526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d8e498d8-961d-4a08-abd8-239ebd43ec91 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:52 devstack sudo[89354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d8e498d8-961d-4a08-abd8-239ebd43ec91 Apr 25 15:55:52 devstack sudo[89354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:53 devstack sudo[89352]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a8fa6480-169e-4edc-9eb7-465110b12bfb tempest-VolumeDependencyTests-1092498908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.485s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:53 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-a8fa6480-169e-4edc-9eb7-465110b12bfb tempest-VolumeDependencyTests-1092498908 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:55:53 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-a8fa6480-169e-4edc-9eb7-465110b12bfb tempest-VolumeDependencyTests-1092498908 None] Deleted volume successfully. Apr 25 15:55:53 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a8fa6480-169e-4edc-9eb7-465110b12bfb tempest-VolumeDependencyTests-1092498908 None] Lock "cinder-afa65097-a3fa-43e3-b538-2fdc13438897-delete_volume" released by "delete_volume" :: held 1.713s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:55:53 devstack sudo[89354]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e3d83e26-ea15-465b-a51b-bb37160f485f tempest-VolumesActionsTest-980582526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d8e498d8-961d-4a08-abd8-239ebd43ec91" returned: 0 in 0.521s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e3d83e26-ea15-465b-a51b-bb37160f485f tempest-VolumesActionsTest-980582526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d8e498d8-961d-4a08-abd8-239ebd43ec91 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:53 devstack sudo[89360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d8e498d8-961d-4a08-abd8-239ebd43ec91 Apr 25 15:55:53 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:53 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e3d83e26-ea15-465b-a51b-bb37160f485f tempest-VolumesActionsTest-980582526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-d8e498d8-961d-4a08-abd8-239ebd43ec91" returned: 0 in 0.445s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:53 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e3d83e26-ea15-465b-a51b-bb37160f485f tempest-VolumesActionsTest-980582526 None] Lock "cinder-quobyte-d8e498d8-961d-4a08-abd8-239ebd43ec91" released by "delete_volume" :: held 1.012s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:55:53 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-e3d83e26-ea15-465b-a51b-bb37160f485f tempest-VolumesActionsTest-980582526 None] Created reservations ['91831dc4-bcba-4d58-bca9-52c6e9b67776', 'bff7a43c-521b-4ce8-850d-07786d4b5d10', '55921a99-3998-4857-9f1e-08be3d9b6ed8', '1d64a885-ab6d-4b04-983f-9548868ccb0a'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:55:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e3d83e26-ea15-465b-a51b-bb37160f485f tempest-VolumesActionsTest-980582526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:55:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e3d83e26-ea15-465b-a51b-bb37160f485f tempest-VolumesActionsTest-980582526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:55:53 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e3d83e26-ea15-465b-a51b-bb37160f485f tempest-VolumesActionsTest-980582526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:55:53 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e3d83e26-ea15-465b-a51b-bb37160f485f tempest-VolumesActionsTest-980582526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:55:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e3d83e26-ea15-465b-a51b-bb37160f485f tempest-VolumesActionsTest-980582526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:55:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e3d83e26-ea15-465b-a51b-bb37160f485f tempest-VolumesActionsTest-980582526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:53 devstack sudo[89363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:55:53 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:54 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e3d83e26-ea15-465b-a51b-bb37160f485f tempest-VolumesActionsTest-980582526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.506s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:54 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-e3d83e26-ea15-465b-a51b-bb37160f485f tempest-VolumesActionsTest-980582526 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:55:54 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-e3d83e26-ea15-465b-a51b-bb37160f485f tempest-VolumesActionsTest-980582526 None] Deleted volume successfully. Apr 25 15:55:54 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e3d83e26-ea15-465b-a51b-bb37160f485f tempest-VolumesActionsTest-980582526 None] Lock "cinder-d8e498d8-961d-4a08-abd8-239ebd43ec91-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:55:55 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:55:55 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] Flow 'volume_create_manager' (b0549b0b-ffab-4c72-8218-3e4213aa57fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:55:55 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14339053-fdf7-49ee-827c-d730c935e484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:55 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14339053-fdf7-49ee-827c-d730c935e484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-177703930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f3dae0d-31b2-47ac-9585-02538e3e2d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b44208f39e4039a3b4756cbd7be8d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:55:55Z,use_quota=True,user_id='badc7fd858744c898cba471c80b00004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:55 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b322c6db-c657-490b-96e7-514f74576b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:55 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b322c6db-c657-490b-96e7-514f74576b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:55 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2364739a-defe-48c4-bb82-072274c6b2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:55 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2364739a-defe-48c4-bb82-072274c6b2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f3dae0d-31b2-47ac-9585-02538e3e2d07', 'volume_name': 'volume-6f3dae0d-31b2-47ac-9585-02538e3e2d07', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:55 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865eccc6-3d37-4434-a365-b20b9fecbe15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:55 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865eccc6-3d37-4434-a365-b20b9fecbe15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:55 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e02cc977-d373-4535-bdde-263c0052804b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:55 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] Volume 6f3dae0d-31b2-47ac-9585-02538e3e2d07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f3dae0d-31b2-47ac-9585-02538e3e2d07', 'volume_size': 1} Apr 25 15:55:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:55:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:55:55 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-177703930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f3dae0d-31b2-47ac-9585-02538e3e2d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b44208f39e4039a3b4756cbd7be8d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:55:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:55:55Z,use_quota=True,user_id='badc7fd858744c898cba471c80b00004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:55:55 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] Creating volume 6f3dae0d-31b2-47ac-9585-02538e3e2d07 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:55:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:55:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:55:55 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:55:55 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:55:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:55:55 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:55:55 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:55:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6f3dae0d-31b2-47ac-9585-02538e3e2d07 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:55 devstack sudo[89367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6f3dae0d-31b2-47ac-9585-02538e3e2d07 1073741824 Apr 25 15:55:55 devstack sudo[89367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:56 devstack sudo[89367]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6f3dae0d-31b2-47ac-9585-02538e3e2d07 1073741824" returned: 0 in 0.682s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6f3dae0d-31b2-47ac-9585-02538e3e2d07 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:56 devstack sudo[89372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6f3dae0d-31b2-47ac-9585-02538e3e2d07 Apr 25 15:55:56 devstack sudo[89372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:56 devstack sudo[89372]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6f3dae0d-31b2-47ac-9585-02538e3e2d07" returned: 0 in 0.535s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:56 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] <== create_volume: return (1263ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:55:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.265s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:55:56 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e02cc977-d373-4535-bdde-263c0052804b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f3dae0d-31b2-47ac-9585-02538e3e2d07', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:56 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e12e0e64-77b6-4d25-bc40-fa007502bcae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:55:56 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] Volume volume-6f3dae0d-31b2-47ac-9585-02538e3e2d07 (6f3dae0d-31b2-47ac-9585-02538e3e2d07): created successfully Apr 25 15:55:56 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e12e0e64-77b6-4d25-bc40-fa007502bcae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:55:56 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] Flow 'volume_create_manager' (b0549b0b-ffab-4c72-8218-3e4213aa57fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:55:56 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-a9c524b2-4d8e-429e-bced-ea941fe06a39 tempest-VolumesActionsTest-955970035 None] Created volume successfully. Apr 25 15:55:57 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d72c3b3e-eeaa-49e2-8977-865c311d8135 tempest-VolumesActionsTest-980582526 None] Acquiring lock "cinder-6f3dae0d-31b2-47ac-9585-02538e3e2d07-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:55:57 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d72c3b3e-eeaa-49e2-8977-865c311d8135 tempest-VolumesActionsTest-980582526 None] Lock "cinder-6f3dae0d-31b2-47ac-9585-02538e3e2d07-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:55:57 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d72c3b3e-eeaa-49e2-8977-865c311d8135 tempest-VolumesActionsTest-980582526 None] Acquiring lock "cinder-quobyte-6f3dae0d-31b2-47ac-9585-02538e3e2d07" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:55:57 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d72c3b3e-eeaa-49e2-8977-865c311d8135 tempest-VolumesActionsTest-980582526 None] Lock "cinder-quobyte-6f3dae0d-31b2-47ac-9585-02538e3e2d07" acquired by "delete_volume" :: waited 0.019s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:55:57 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31828b7-896d-47c8-8a90-b3ad45e2ff6b]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:55:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d72c3b3e-eeaa-49e2-8977-865c311d8135 tempest-VolumesActionsTest-980582526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6f3dae0d-31b2-47ac-9585-02538e3e2d07 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:57 devstack sudo[89375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6f3dae0d-31b2-47ac-9585-02538e3e2d07 Apr 25 15:55:57 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:58 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d72c3b3e-eeaa-49e2-8977-865c311d8135 tempest-VolumesActionsTest-980582526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6f3dae0d-31b2-47ac-9585-02538e3e2d07" returned: 0 in 0.589s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d72c3b3e-eeaa-49e2-8977-865c311d8135 tempest-VolumesActionsTest-980582526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6f3dae0d-31b2-47ac-9585-02538e3e2d07 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:58 devstack sudo[89380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6f3dae0d-31b2-47ac-9585-02538e3e2d07 Apr 25 15:55:58 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:58 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d72c3b3e-eeaa-49e2-8977-865c311d8135 tempest-VolumesActionsTest-980582526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6f3dae0d-31b2-47ac-9585-02538e3e2d07" returned: 0 in 0.499s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:58 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d72c3b3e-eeaa-49e2-8977-865c311d8135 tempest-VolumesActionsTest-980582526 None] Lock "cinder-quobyte-6f3dae0d-31b2-47ac-9585-02538e3e2d07" released by "delete_volume" :: held 1.130s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:55:58 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-d72c3b3e-eeaa-49e2-8977-865c311d8135 tempest-VolumesActionsTest-980582526 None] Created reservations ['0e19daa8-24cc-4c56-99d5-b915ba870dfe', 'b42e4689-1e7a-49f1-8aaf-d4cc296be222', 'cda273fd-8c31-4df8-ac5c-7590cdc0c7a9', '64dbee5b-699d-4717-8a03-a06ee159559e'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:55:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d72c3b3e-eeaa-49e2-8977-865c311d8135 tempest-VolumesActionsTest-980582526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:55:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d72c3b3e-eeaa-49e2-8977-865c311d8135 tempest-VolumesActionsTest-980582526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:55:58 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d72c3b3e-eeaa-49e2-8977-865c311d8135 tempest-VolumesActionsTest-980582526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:55:58 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d72c3b3e-eeaa-49e2-8977-865c311d8135 tempest-VolumesActionsTest-980582526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:55:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d72c3b3e-eeaa-49e2-8977-865c311d8135 tempest-VolumesActionsTest-980582526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:55:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d72c3b3e-eeaa-49e2-8977-865c311d8135 tempest-VolumesActionsTest-980582526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:55:58 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:55:58 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:55:59 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Apr 25 15:55:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d72c3b3e-eeaa-49e2-8977-865c311d8135 tempest-VolumesActionsTest-980582526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.447s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:55:59 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-d72c3b3e-eeaa-49e2-8977-865c311d8135 tempest-VolumesActionsTest-980582526 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:55:59 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-d72c3b3e-eeaa-49e2-8977-865c311d8135 tempest-VolumesActionsTest-980582526 None] Deleted volume successfully. Apr 25 15:55:59 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d72c3b3e-eeaa-49e2-8977-865c311d8135 tempest-VolumesActionsTest-980582526 None] Lock "cinder-6f3dae0d-31b2-47ac-9585-02538e3e2d07-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:56:00 devstack cinder-volume[81828]: DEBUG oslo_service.periodic_task [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81828) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 25 15:56:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:56:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:56:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:56:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:56:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:56:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:00 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:56:00 devstack sudo[89386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:56:00 devstack sudo[89386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:00 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] Flow 'volume_create_manager' (e5ee6246-321f-4e4f-a9de-f1e8f27105ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:56:00 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa22384d-d981-45b8-8e3d-5931de391b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:00 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa22384d-d981-45b8-8e3d-5931de391b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-513766661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b998846a-a7df-495e-9dc6-665cbe0d1f06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b44208f39e4039a3b4756cbd7be8d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:56:00Z,use_quota=True,user_id='badc7fd858744c898cba471c80b00004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:00 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0edf8289-7e31-4619-a755-b2f889347659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:00 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0edf8289-7e31-4619-a755-b2f889347659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:00 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6554adeb-538f-4db4-a62d-8dd63f0e6643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:00 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6554adeb-538f-4db4-a62d-8dd63f0e6643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b998846a-a7df-495e-9dc6-665cbe0d1f06', 'volume_name': 'volume-b998846a-a7df-495e-9dc6-665cbe0d1f06', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:00 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4e39f1-e2dd-44c2-8693-bde92b43e978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:00 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a4e39f1-e2dd-44c2-8693-bde92b43e978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:00 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a040071c-bf89-4899-8b09-da2e118062b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:00 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] Volume b998846a-a7df-495e-9dc6-665cbe0d1f06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b998846a-a7df-495e-9dc6-665cbe0d1f06', 'volume_size': 1} Apr 25 15:56:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:56:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:56:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:56:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-513766661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b998846a-a7df-495e-9dc6-665cbe0d1f06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b44208f39e4039a3b4756cbd7be8d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:56:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:56:00Z,use_quota=True,user_id='badc7fd858744c898cba471c80b00004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:56:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] Creating volume b998846a-a7df-495e-9dc6-665cbe0d1f06 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:56:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:56:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:56:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:56:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:56:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:56:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:56:00 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:56:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b998846a-a7df-495e-9dc6-665cbe0d1f06 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:00 devstack sudo[89388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b998846a-a7df-495e-9dc6-665cbe0d1f06 1073741824 Apr 25 15:56:00 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:00 devstack sudo[89386]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.500s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:00 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:56:01 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b998846a-a7df-495e-9dc6-665cbe0d1f06 1073741824" returned: 0 in 0.719s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b998846a-a7df-495e-9dc6-665cbe0d1f06 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:01 devstack sudo[89394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b998846a-a7df-495e-9dc6-665cbe0d1f06 Apr 25 15:56:01 devstack sudo[89394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:01 devstack sudo[89394]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b998846a-a7df-495e-9dc6-665cbe0d1f06" returned: 0 in 0.513s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:01 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] <== create_volume: return (1272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:56:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.275s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:56:01 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a040071c-bf89-4899-8b09-da2e118062b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b998846a-a7df-495e-9dc6-665cbe0d1f06', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:01 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e7a93a-2705-4a4c-9116-a0ecc4582675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:01 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] Volume volume-b998846a-a7df-495e-9dc6-665cbe0d1f06 (b998846a-a7df-495e-9dc6-665cbe0d1f06): created successfully Apr 25 15:56:01 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92e7a93a-2705-4a4c-9116-a0ecc4582675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:01 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] Flow 'volume_create_manager' (e5ee6246-321f-4e4f-a9de-f1e8f27105ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:56:01 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-83f5d7cf-f30b-4262-bb5d-0f6184a7ab56 tempest-VolumesActionsTest-955970035 None] Created volume successfully. Apr 25 15:56:02 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-1338fa4a-6d11-4836-a0f6-aaf5a74cd9bf tempest-VolumesActionsTest-980582526 None] Acquiring lock "cinder-b998846a-a7df-495e-9dc6-665cbe0d1f06-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:56:02 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-1338fa4a-6d11-4836-a0f6-aaf5a74cd9bf tempest-VolumesActionsTest-980582526 None] Lock "cinder-b998846a-a7df-495e-9dc6-665cbe0d1f06-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:56:02 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-1338fa4a-6d11-4836-a0f6-aaf5a74cd9bf tempest-VolumesActionsTest-980582526 None] Acquiring lock "cinder-quobyte-b998846a-a7df-495e-9dc6-665cbe0d1f06" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:56:02 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-1338fa4a-6d11-4836-a0f6-aaf5a74cd9bf tempest-VolumesActionsTest-980582526 None] Lock "cinder-quobyte-b998846a-a7df-495e-9dc6-665cbe0d1f06" acquired by "delete_volume" :: waited 0.018s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:56:02 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9463c8a-813b-4d71-8e2d-834cc50e1fbb]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:56:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1338fa4a-6d11-4836-a0f6-aaf5a74cd9bf tempest-VolumesActionsTest-980582526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b998846a-a7df-495e-9dc6-665cbe0d1f06 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:02 devstack sudo[89398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b998846a-a7df-495e-9dc6-665cbe0d1f06 Apr 25 15:56:02 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:03 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1338fa4a-6d11-4836-a0f6-aaf5a74cd9bf tempest-VolumesActionsTest-980582526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b998846a-a7df-495e-9dc6-665cbe0d1f06" returned: 0 in 0.608s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1338fa4a-6d11-4836-a0f6-aaf5a74cd9bf tempest-VolumesActionsTest-980582526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b998846a-a7df-495e-9dc6-665cbe0d1f06 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:03 devstack sudo[89403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b998846a-a7df-495e-9dc6-665cbe0d1f06 Apr 25 15:56:03 devstack sudo[89403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:03 devstack sudo[89403]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1338fa4a-6d11-4836-a0f6-aaf5a74cd9bf tempest-VolumesActionsTest-980582526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b998846a-a7df-495e-9dc6-665cbe0d1f06" returned: 0 in 0.482s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:03 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-1338fa4a-6d11-4836-a0f6-aaf5a74cd9bf tempest-VolumesActionsTest-980582526 None] Lock "cinder-quobyte-b998846a-a7df-495e-9dc6-665cbe0d1f06" released by "delete_volume" :: held 1.149s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:56:03 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:SELECT=91,cinder:INSERT=27,cinder:UPDATE=105,cinder:DELETE=5 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:56:03 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:SELECT=78,cinder:INSERT=26,cinder:UPDATE=115,cinder:DELETE=14 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:56:03 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-1338fa4a-6d11-4836-a0f6-aaf5a74cd9bf tempest-VolumesActionsTest-980582526 None] Created reservations ['eadc0f22-5ee6-439f-8ea3-4b4cb4cd949f', 'a6d27c24-8117-49f3-ad94-f4567a14724e', '1fe88130-0791-4e05-a29d-e4b5ed59c1d5', '34b379a0-5dfd-4c4b-9540-b46a6673e190'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:56:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1338fa4a-6d11-4836-a0f6-aaf5a74cd9bf tempest-VolumesActionsTest-980582526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:56:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1338fa4a-6d11-4836-a0f6-aaf5a74cd9bf tempest-VolumesActionsTest-980582526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:56:03 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1338fa4a-6d11-4836-a0f6-aaf5a74cd9bf tempest-VolumesActionsTest-980582526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:56:03 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1338fa4a-6d11-4836-a0f6-aaf5a74cd9bf tempest-VolumesActionsTest-980582526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:56:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1338fa4a-6d11-4836-a0f6-aaf5a74cd9bf tempest-VolumesActionsTest-980582526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:56:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1338fa4a-6d11-4836-a0f6-aaf5a74cd9bf tempest-VolumesActionsTest-980582526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:03 devstack sudo[89406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:56:03 devstack sudo[89406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:04 devstack sudo[89406]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1338fa4a-6d11-4836-a0f6-aaf5a74cd9bf tempest-VolumesActionsTest-980582526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.491s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:04 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-1338fa4a-6d11-4836-a0f6-aaf5a74cd9bf tempest-VolumesActionsTest-980582526 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:56:04 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-1338fa4a-6d11-4836-a0f6-aaf5a74cd9bf tempest-VolumesActionsTest-980582526 None] Deleted volume successfully. Apr 25 15:56:04 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-1338fa4a-6d11-4836-a0f6-aaf5a74cd9bf tempest-VolumesActionsTest-980582526 None] Lock "cinder-b998846a-a7df-495e-9dc6-665cbe0d1f06-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:56:05 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:56:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] Flow 'volume_create_manager' (cb085b74-4662-4cc9-a9f2-309ef1ab6333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:56:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f50e6d90-d376-4233-aec6-c2d6147b2233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f50e6d90-d376-4233-aec6-c2d6147b2233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1816128798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1aa7f7e-a13b-4f7f-aa9b-972edf6e7f42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b44208f39e4039a3b4756cbd7be8d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:56:05Z,use_quota=True,user_id='badc7fd858744c898cba471c80b00004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d77f5c9d-f0ae-4c68-83f1-426d6f7d9a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d77f5c9d-f0ae-4c68-83f1-426d6f7d9a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b35d7e91-5b88-41ad-9ff0-6bc8a161962e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b35d7e91-5b88-41ad-9ff0-6bc8a161962e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1aa7f7e-a13b-4f7f-aa9b-972edf6e7f42', 'volume_name': 'volume-f1aa7f7e-a13b-4f7f-aa9b-972edf6e7f42', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (576b91a4-12f9-4aed-b844-46a4eb769d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (576b91a4-12f9-4aed-b844-46a4eb769d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d83b71c-4d60-4e59-9d0c-de98ab00b66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:05 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] Volume f1aa7f7e-a13b-4f7f-aa9b-972edf6e7f42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1aa7f7e-a13b-4f7f-aa9b-972edf6e7f42', 'volume_size': 1} Apr 25 15:56:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:56:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:56:05 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1816128798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1aa7f7e-a13b-4f7f-aa9b-972edf6e7f42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89b44208f39e4039a3b4756cbd7be8d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:56:05Z,use_quota=True,user_id='badc7fd858744c898cba471c80b00004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:56:05 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] Creating volume f1aa7f7e-a13b-4f7f-aa9b-972edf6e7f42 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:56:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:56:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:56:05 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:56:05 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:56:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:56:05 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:56:05 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:56:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f1aa7f7e-a13b-4f7f-aa9b-972edf6e7f42 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:05 devstack sudo[89409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f1aa7f7e-a13b-4f7f-aa9b-972edf6e7f42 1073741824 Apr 25 15:56:05 devstack sudo[89409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:05 devstack sudo[89409]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f1aa7f7e-a13b-4f7f-aa9b-972edf6e7f42 1073741824" returned: 0 in 0.693s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f1aa7f7e-a13b-4f7f-aa9b-972edf6e7f42 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:05 devstack sudo[89414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f1aa7f7e-a13b-4f7f-aa9b-972edf6e7f42 Apr 25 15:56:05 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:06 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f1aa7f7e-a13b-4f7f-aa9b-972edf6e7f42" returned: 0 in 0.472s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:06 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:56:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:56:06 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d83b71c-4d60-4e59-9d0c-de98ab00b66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1aa7f7e-a13b-4f7f-aa9b-972edf6e7f42', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:06 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a29c12-321e-4914-b958-0e609038bc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:06 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] Volume volume-f1aa7f7e-a13b-4f7f-aa9b-972edf6e7f42 (f1aa7f7e-a13b-4f7f-aa9b-972edf6e7f42): created successfully Apr 25 15:56:06 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a29c12-321e-4914-b958-0e609038bc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:06 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] Flow 'volume_create_manager' (cb085b74-4662-4cc9-a9f2-309ef1ab6333) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:56:06 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-58992b49-9d58-4119-bf08-4039d1983b97 tempest-VolumesActionsTest-955970035 None] Created volume successfully. Apr 25 15:56:07 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9abc58f3-b15f-4f4c-8623-3de9ffada4dc tempest-VolumesActionsTest-955970035 None] Acquiring lock "cinder-f1aa7f7e-a13b-4f7f-aa9b-972edf6e7f42-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:56:07 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9abc58f3-b15f-4f4c-8623-3de9ffada4dc tempest-VolumesActionsTest-955970035 None] Lock "cinder-f1aa7f7e-a13b-4f7f-aa9b-972edf6e7f42-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:56:07 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9abc58f3-b15f-4f4c-8623-3de9ffada4dc tempest-VolumesActionsTest-955970035 None] Acquiring lock "cinder-quobyte-f1aa7f7e-a13b-4f7f-aa9b-972edf6e7f42" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:56:07 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9abc58f3-b15f-4f4c-8623-3de9ffada4dc tempest-VolumesActionsTest-955970035 None] Lock "cinder-quobyte-f1aa7f7e-a13b-4f7f-aa9b-972edf6e7f42" acquired by "delete_volume" :: waited 0.015s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:56:08 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[9352bc2b-858f-4a9f-bd0a-617274124931]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:56:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9abc58f3-b15f-4f4c-8623-3de9ffada4dc tempest-VolumesActionsTest-955970035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f1aa7f7e-a13b-4f7f-aa9b-972edf6e7f42 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:08 devstack sudo[89417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f1aa7f7e-a13b-4f7f-aa9b-972edf6e7f42 Apr 25 15:56:08 devstack sudo[89417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:08 devstack sudo[89417]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9abc58f3-b15f-4f4c-8623-3de9ffada4dc tempest-VolumesActionsTest-955970035 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f1aa7f7e-a13b-4f7f-aa9b-972edf6e7f42" returned: 0 in 0.563s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9abc58f3-b15f-4f4c-8623-3de9ffada4dc tempest-VolumesActionsTest-955970035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f1aa7f7e-a13b-4f7f-aa9b-972edf6e7f42 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:08 devstack sudo[89422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f1aa7f7e-a13b-4f7f-aa9b-972edf6e7f42 Apr 25 15:56:08 devstack sudo[89422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:09 devstack sudo[89422]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9abc58f3-b15f-4f4c-8623-3de9ffada4dc tempest-VolumesActionsTest-955970035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f1aa7f7e-a13b-4f7f-aa9b-972edf6e7f42" returned: 0 in 0.486s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:09 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9abc58f3-b15f-4f4c-8623-3de9ffada4dc tempest-VolumesActionsTest-955970035 None] Lock "cinder-quobyte-f1aa7f7e-a13b-4f7f-aa9b-972edf6e7f42" released by "delete_volume" :: held 1.096s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:56:09 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-9abc58f3-b15f-4f4c-8623-3de9ffada4dc tempest-VolumesActionsTest-955970035 None] Created reservations ['73179d70-ed44-482e-a910-e502edda88ee', '3b5ee222-fb65-4014-9842-3c8e501ccdea', '08384dec-114a-4466-8e6e-12a470778243', '4f47c237-92aa-43f8-9c22-471c01f6ad39'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:56:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9abc58f3-b15f-4f4c-8623-3de9ffada4dc tempest-VolumesActionsTest-955970035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:56:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9abc58f3-b15f-4f4c-8623-3de9ffada4dc tempest-VolumesActionsTest-955970035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:56:09 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-9abc58f3-b15f-4f4c-8623-3de9ffada4dc tempest-VolumesActionsTest-955970035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:56:09 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-9abc58f3-b15f-4f4c-8623-3de9ffada4dc tempest-VolumesActionsTest-955970035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:56:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9abc58f3-b15f-4f4c-8623-3de9ffada4dc tempest-VolumesActionsTest-955970035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:56:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9abc58f3-b15f-4f4c-8623-3de9ffada4dc tempest-VolumesActionsTest-955970035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:09 devstack sudo[89425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:56:09 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:09 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9abc58f3-b15f-4f4c-8623-3de9ffada4dc tempest-VolumesActionsTest-955970035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.524s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:09 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-9abc58f3-b15f-4f4c-8623-3de9ffada4dc tempest-VolumesActionsTest-955970035 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:56:09 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-9abc58f3-b15f-4f4c-8623-3de9ffada4dc tempest-VolumesActionsTest-955970035 None] Deleted volume successfully. Apr 25 15:56:09 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-9abc58f3-b15f-4f4c-8623-3de9ffada4dc tempest-VolumesActionsTest-955970035 None] Lock "cinder-f1aa7f7e-a13b-4f7f-aa9b-972edf6e7f42-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:56:13 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:56:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] Flow 'volume_create_manager' (e6920898-2a7a-482c-8525-fe01a669c7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:56:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (366913e4-8a60-4fbc-97bd-34e156852104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (366913e4-8a60-4fbc-97bd-34e156852104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-175337790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12fb8f43-7da9-47bf-9585-656fbf758f93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d7c4f86bb8f4bb3b4e9d787f4ff5e3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:56:14Z,use_quota=True,user_id='c240274f6c104ff0bb47ca652519962e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4ca44e-3e47-4c7c-99d8-ef5d5bc9457a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c4ca44e-3e47-4c7c-99d8-ef5d5bc9457a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af3ad2f4-4db4-4f2b-8576-17d7787598a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af3ad2f4-4db4-4f2b-8576-17d7787598a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12fb8f43-7da9-47bf-9585-656fbf758f93', 'volume_name': 'volume-12fb8f43-7da9-47bf-9585-656fbf758f93', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b4eff86-63b3-4cb0-a9c6-2950e7cd262b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b4eff86-63b3-4cb0-a9c6-2950e7cd262b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6dad28-70a1-4a6f-b064-3f2d4d4f60e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:14 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] Volume 12fb8f43-7da9-47bf-9585-656fbf758f93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12fb8f43-7da9-47bf-9585-656fbf758f93', 'volume_size': 1} Apr 25 15:56:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:56:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:56:14 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:56:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-175337790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12fb8f43-7da9-47bf-9585-656fbf758f93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d7c4f86bb8f4bb3b4e9d787f4ff5e3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:56:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:56:14Z,use_quota=True,user_id='c240274f6c104ff0bb47ca652519962e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:56:14 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] Creating volume 12fb8f43-7da9-47bf-9585-656fbf758f93 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:56:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:56:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:56:14 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:56:14 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:56:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:56:14 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:56:14 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:56:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:14 devstack sudo[89463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93 1073741824 Apr 25 15:56:14 devstack sudo[89463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:14 devstack sudo[89463]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93 1073741824" returned: 0 in 0.646s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:14 devstack sudo[89468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93 Apr 25 15:56:14 devstack sudo[89468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:15 devstack sudo[89468]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93" returned: 0 in 0.489s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:56:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:56:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6dad28-70a1-4a6f-b064-3f2d4d4f60e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12fb8f43-7da9-47bf-9585-656fbf758f93', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (792ad184-e60f-42d2-bee2-c8f842fbc1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:15 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] Volume volume-12fb8f43-7da9-47bf-9585-656fbf758f93 (12fb8f43-7da9-47bf-9585-656fbf758f93): created successfully Apr 25 15:56:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (792ad184-e60f-42d2-bee2-c8f842fbc1de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] Flow 'volume_create_manager' (e6920898-2a7a-482c-8525-fe01a669c7df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:56:15 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-4dec9963-9ba0-4f07-b15a-eb29c14c13de tempest-SnapshotDependencyTests-1706104321 None] Created volume successfully. Apr 25 15:56:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9fe06b91-02bd-4199-ac50-1e18e0f97a7e tempest-SnapshotDependencyTests-1706104321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:56:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9fe06b91-02bd-4199-ac50-1e18e0f97a7e tempest-SnapshotDependencyTests-1706104321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:56:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-9fe06b91-02bd-4199-ac50-1e18e0f97a7e tempest-SnapshotDependencyTests-1706104321 None] Creating offline snapshot 5be5a309-1b1d-43a3-a613-d7f094605521 of volume 12fb8f43-7da9-47bf-9585-656fbf758f93 {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 15:56:16 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7aca130-f70f-48b5-8073-ec491a0bd9ce]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:56:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9fe06b91-02bd-4199-ac50-1e18e0f97a7e tempest-SnapshotDependencyTests-1706104321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:16 devstack sudo[89472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93 Apr 25 15:56:16 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:17 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9fe06b91-02bd-4199-ac50-1e18e0f97a7e tempest-SnapshotDependencyTests-1706104321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93" returned: 0 in 0.601s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9fe06b91-02bd-4199-ac50-1e18e0f97a7e tempest-SnapshotDependencyTests-1706104321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93.5be5a309-1b1d-43a3-a613-d7f094605521 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:17 devstack sudo[89477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93.5be5a309-1b1d-43a3-a613-d7f094605521 1G Apr 25 15:56:17 devstack sudo[89477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:17 devstack sudo[89477]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9fe06b91-02bd-4199-ac50-1e18e0f97a7e tempest-SnapshotDependencyTests-1706104321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93.5be5a309-1b1d-43a3-a613-d7f094605521 1G" returned: 0 in 0.672s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9fe06b91-02bd-4199-ac50-1e18e0f97a7e tempest-SnapshotDependencyTests-1706104321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12fb8f43-7da9-47bf-9585-656fbf758f93 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93.5be5a309-1b1d-43a3-a613-d7f094605521 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:17 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12fb8f43-7da9-47bf-9585-656fbf758f93 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93.5be5a309-1b1d-43a3-a613-d7f094605521 Apr 25 15:56:17 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:18 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9fe06b91-02bd-4199-ac50-1e18e0f97a7e tempest-SnapshotDependencyTests-1706104321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12fb8f43-7da9-47bf-9585-656fbf758f93 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93.5be5a309-1b1d-43a3-a613-d7f094605521" returned: 0 in 0.549s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:18 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-9fe06b91-02bd-4199-ac50-1e18e0f97a7e tempest-SnapshotDependencyTests-1706104321 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93.5be5a309-1b1d-43a3-a613-d7f094605521 is being set with open permissions: ugo+rw Apr 25 15:56:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9fe06b91-02bd-4199-ac50-1e18e0f97a7e tempest-SnapshotDependencyTests-1706104321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93.5be5a309-1b1d-43a3-a613-d7f094605521 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:18 devstack sudo[89488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93.5be5a309-1b1d-43a3-a613-d7f094605521 Apr 25 15:56:18 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:18 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9fe06b91-02bd-4199-ac50-1e18e0f97a7e tempest-SnapshotDependencyTests-1706104321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93.5be5a309-1b1d-43a3-a613-d7f094605521" returned: 0 in 0.482s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9fe06b91-02bd-4199-ac50-1e18e0f97a7e tempest-SnapshotDependencyTests-1706104321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:18 devstack sudo[89491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93.info Apr 25 15:56:18 devstack sudo[89491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:19 devstack sudo[89491]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9fe06b91-02bd-4199-ac50-1e18e0f97a7e tempest-SnapshotDependencyTests-1706104321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93.info" returned: 0 in 0.521s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:19 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-9fe06b91-02bd-4199-ac50-1e18e0f97a7e tempest-SnapshotDependencyTests-1706104321 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93.info is being set with open permissions: ugo+rw Apr 25 15:56:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9fe06b91-02bd-4199-ac50-1e18e0f97a7e tempest-SnapshotDependencyTests-1706104321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:19 devstack sudo[89495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93.info Apr 25 15:56:19 devstack sudo[89495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:19 devstack sudo[89495]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-9fe06b91-02bd-4199-ac50-1e18e0f97a7e tempest-SnapshotDependencyTests-1706104321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93.info" returned: 0 in 0.454s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-9fe06b91-02bd-4199-ac50-1e18e0f97a7e tempest-SnapshotDependencyTests-1706104321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.396s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:56:19 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-9fe06b91-02bd-4199-ac50-1e18e0f97a7e tempest-SnapshotDependencyTests-1706104321 None] Create snapshot completed successfully Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Flow 'volume_create_manager' (b101acfa-6706-4b22-ac7d-41a9ec60c5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (432a4fbf-6e84-4649-91a8-1e761eac708f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (432a4fbf-6e84-4649-91a8-1e761eac708f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf35b0a2-eee3-4f8f-b5c4-8d432252326f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d7c4f86bb8f4bb3b4e9d787f4ff5e3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:56:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5be5a309-1b1d-43a3-a613-d7f094605521,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:56:21Z,use_quota=True,user_id='c240274f6c104ff0bb47ca652519962e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f9cc6e-41ce-479b-92e3-624eab1509b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f9cc6e-41ce-479b-92e3-624eab1509b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aadaed23-278d-43ec-b581-a64fe73ccff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aadaed23-278d-43ec-b581-a64fe73ccff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bf35b0a2-eee3-4f8f-b5c4-8d432252326f', 'volume_name': 'volume-bf35b0a2-eee3-4f8f-b5c4-8d432252326f', 'volume_size': 1, 'snapshot_id': '5be5a309-1b1d-43a3-a613-d7f094605521'}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14faa007-5e93-4271-9cbf-36c4317fb8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14faa007-5e93-4271-9cbf-36c4317fb8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (163ffa7c-c0ad-4663-8e29-be27a30867a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:21 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Volume bf35b0a2-eee3-4f8f-b5c4-8d432252326f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bf35b0a2-eee3-4f8f-b5c4-8d432252326f', 'volume_size': 1, 'snapshot_id': '5be5a309-1b1d-43a3-a613-d7f094605521'} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Acquiring lock "cinder-quobyte-5be5a309-1b1d-43a3-a613-d7f094605521-bf35b0a2-eee3-4f8f-b5c4-8d432252326f" by "_create_volume_from_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Lock "cinder-quobyte-5be5a309-1b1d-43a3-a613-d7f094605521-bf35b0a2-eee3-4f8f-b5c4-8d432252326f" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Creating volume bf35b0a2-eee3-4f8f-b5c4-8d432252326f from snapshot 5be5a309-1b1d-43a3-a613-d7f094605521 {{(pid=81828) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Acquiring lock "cinder-quobyte-bf35b0a2-eee3-4f8f-b5c4-8d432252326f" by "_copy_volume_from_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Lock "cinder-quobyte-bf35b0a2-eee3-4f8f-b5c4-8d432252326f" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] snapshot: 5be5a309-1b1d-43a3-a613-d7f094605521, volume: bf35b0a2-eee3-4f8f-b5c4-8d432252326f, {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ef6e2e-fe1b-4611-8598-1cfbade729dd]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93.5be5a309-1b1d-43a3-a613-d7f094605521 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:21 devstack sudo[89499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93.5be5a309-1b1d-43a3-a613-d7f094605521 Apr 25 15:56:21 devstack sudo[89499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:21 devstack sudo[89499]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93.5be5a309-1b1d-43a3-a613-d7f094605521" returned: 0 in 0.637s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12fb8f43-7da9-47bf-9585-656fbf758f93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] will copy from snapshot at /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93 {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Creating direct copy from snapshot {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7dbaad-793f-43ff-8c8a-9cbcc68c6d42]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:56:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:22 devstack sudo[89506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93 Apr 25 15:56:22 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:22 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93" returned: 0 in 0.655s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:22 devstack cinder-volume[81828]: DEBUG cinder.utils [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Path /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bf35b0a2-eee3-4f8f-b5c4-8d432252326f not found in is_blk_device check {{(pid=81828) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 25 15:56:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bf35b0a2-eee3-4f8f-b5c4-8d432252326f {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:22 devstack sudo[89511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bf35b0a2-eee3-4f8f-b5c4-8d432252326f Apr 25 15:56:22 devstack sudo[89511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:24 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:56:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] Flow 'volume_create_manager' (adec19c5-e8b1-4524-8acb-0df684d9a833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:56:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09d803b6-b576-4f30-9ec0-f432873a168f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09d803b6-b576-4f30-9ec0-f432873a168f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1227063462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f0f1fd6-3f70-4171-8a31-058b30907137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f5ed6d8cd94b568f4573f9dcdb8e16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:56:25Z,use_quota=True,user_id='2ac706b82be949d5a58f38a3a4d76ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e97ac790-1d2a-4248-9845-44e9b690cd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e97ac790-1d2a-4248-9845-44e9b690cd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6257b200-d4b9-4791-9adc-274f144e6c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6257b200-d4b9-4791-9adc-274f144e6c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f0f1fd6-3f70-4171-8a31-058b30907137', 'volume_name': 'volume-3f0f1fd6-3f70-4171-8a31-058b30907137', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21e1bd21-5cba-4e42-a018-1b271292666d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21e1bd21-5cba-4e42-a018-1b271292666d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (215339f9-17d3-43bf-9486-5d1e86241f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:25 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] Volume 3f0f1fd6-3f70-4171-8a31-058b30907137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f0f1fd6-3f70-4171-8a31-058b30907137', 'volume_size': 1} Apr 25 15:56:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:56:27 devstack sudo[89511]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bf35b0a2-eee3-4f8f-b5c4-8d432252326f" returned: 0 in 4.660s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:27 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf28b4a-d623-4bef-b39f-9df86fd8afde]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:56:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:27 devstack sudo[89523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93 Apr 25 15:56:27 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:27 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93" returned: 0 in 0.637s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:27 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Image conversion details: src /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93, size 1024.00 MB, duration 4.66 sec, destination /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bf35b0a2-eee3-4f8f-b5c4-8d432252326f {{(pid=81828) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 15:56:27 devstack cinder-volume[81828]: INFO cinder.image.image_utils [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Converted 1024.00 MB image at 219.68 MB/s Apr 25 15:56:27 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bf35b0a2-eee3-4f8f-b5c4-8d432252326f is being set with open permissions: ugo+rw Apr 25 15:56:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bf35b0a2-eee3-4f8f-b5c4-8d432252326f {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:27 devstack sudo[89528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bf35b0a2-eee3-4f8f-b5c4-8d432252326f Apr 25 15:56:27 devstack sudo[89528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:28 devstack sudo[89528]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bf35b0a2-eee3-4f8f-b5c4-8d432252326f" returned: 0 in 0.426s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:28 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Lock "cinder-quobyte-bf35b0a2-eee3-4f8f-b5c4-8d432252326f" released by "_copy_volume_from_snapshot" :: held 7.102s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:56:28 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Lock "cinder-quobyte-5be5a309-1b1d-43a3-a613-d7f094605521-bf35b0a2-eee3-4f8f-b5c4-8d432252326f" released by "_create_volume_from_snapshot" :: held 7.139s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:56:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.163s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:56:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.339s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:56:28 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1227063462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f0f1fd6-3f70-4171-8a31-058b30907137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f5ed6d8cd94b568f4573f9dcdb8e16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:56:25Z,use_quota=True,user_id='2ac706b82be949d5a58f38a3a4d76ef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:56:28 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] Creating volume 3f0f1fd6-3f70-4171-8a31-058b30907137 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:56:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:56:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:56:28 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:56:28 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:56:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:56:28 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:56:28 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:56:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:28 devstack sudo[89531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137 1073741824 Apr 25 15:56:28 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:28 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (163ffa7c-c0ad-4663-8e29-be27a30867a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf35b0a2-eee3-4f8f-b5c4-8d432252326f', 'volume_size': 1, 'snapshot_id': '5be5a309-1b1d-43a3-a613-d7f094605521'}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:28 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be646581-9a32-4fac-b2e6-ab26ab8cf362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:28 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Volume volume-bf35b0a2-eee3-4f8f-b5c4-8d432252326f (bf35b0a2-eee3-4f8f-b5c4-8d432252326f): created successfully Apr 25 15:56:28 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be646581-9a32-4fac-b2e6-ab26ab8cf362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:28 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Flow 'volume_create_manager' (b101acfa-6706-4b22-ac7d-41a9ec60c5fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:56:28 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-a5945952-d01b-49d8-b95b-b8bff746dff0 tempest-SnapshotDependencyTests-1706104321 None] Created volume successfully. Apr 25 15:56:28 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-36719761-3d1f-4534-b8d5-86d8c4b6dd72 tempest-SnapshotDependencyTests-1706104321 None] Acquiring lock "cinder-5be5a309-1b1d-43a3-a613-d7f094605521-delete_snapshot" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:56:28 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-36719761-3d1f-4534-b8d5-86d8c4b6dd72 tempest-SnapshotDependencyTests-1706104321 None] Lock "cinder-5be5a309-1b1d-43a3-a613-d7f094605521-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:56:28 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-36719761-3d1f-4534-b8d5-86d8c4b6dd72 tempest-SnapshotDependencyTests-1706104321 None] Acquiring lock "cinder-quobyte-12fb8f43-7da9-47bf-9585-656fbf758f93" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:56:28 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-36719761-3d1f-4534-b8d5-86d8c4b6dd72 tempest-SnapshotDependencyTests-1706104321 None] Lock "cinder-quobyte-12fb8f43-7da9-47bf-9585-656fbf758f93" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:56:28 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-36719761-3d1f-4534-b8d5-86d8c4b6dd72 tempest-SnapshotDependencyTests-1706104321 None] Acquiring lock "cinder-quobyte-5be5a309-1b1d-43a3-a613-d7f094605521" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:56:28 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-36719761-3d1f-4534-b8d5-86d8c4b6dd72 tempest-SnapshotDependencyTests-1706104321 None] Lock "cinder-quobyte-5be5a309-1b1d-43a3-a613-d7f094605521" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:56:28 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-36719761-3d1f-4534-b8d5-86d8c4b6dd72 tempest-SnapshotDependencyTests-1706104321 None] Deleting offline snapshot 5be5a309-1b1d-43a3-a613-d7f094605521 of volume 12fb8f43-7da9-47bf-9585-656fbf758f93 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 15:56:28 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-36719761-3d1f-4534-b8d5-86d8c4b6dd72 tempest-SnapshotDependencyTests-1706104321 None] snapshot_file for this snap is: volume-12fb8f43-7da9-47bf-9585-656fbf758f93.5be5a309-1b1d-43a3-a613-d7f094605521 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 15:56:28 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87a91a6-fbb8-4300-9e35-7cb2f6d24150]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:56:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-36719761-3d1f-4534-b8d5-86d8c4b6dd72 tempest-SnapshotDependencyTests-1706104321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93.5be5a309-1b1d-43a3-a613-d7f094605521 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:28 devstack sudo[89535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93.5be5a309-1b1d-43a3-a613-d7f094605521 Apr 25 15:56:28 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:28 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137 1073741824" returned: 0 in 0.649s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:29 devstack sudo[89538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137 Apr 25 15:56:29 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:29 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-36719761-3d1f-4534-b8d5-86d8c4b6dd72 tempest-SnapshotDependencyTests-1706104321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93.5be5a309-1b1d-43a3-a613-d7f094605521" returned: 0 in 0.554s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:29 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-36719761-3d1f-4534-b8d5-86d8c4b6dd72 tempest-SnapshotDependencyTests-1706104321 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12fb8f43-7da9-47bf-9585-656fbf758f93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:56:29 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8f4b7d-7dec-4de8-aa2b-a6826e5ddded]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:56:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-36719761-3d1f-4534-b8d5-86d8c4b6dd72 tempest-SnapshotDependencyTests-1706104321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:29 devstack sudo[89543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93 Apr 25 15:56:29 devstack sudo[89543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:29 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137" returned: 0 in 0.456s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:29 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:56:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:56:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (215339f9-17d3-43bf-9486-5d1e86241f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f0f1fd6-3f70-4171-8a31-058b30907137', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1401d56a-6cea-42bf-ad7f-7a623b679212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:29 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] Volume volume-3f0f1fd6-3f70-4171-8a31-058b30907137 (3f0f1fd6-3f70-4171-8a31-058b30907137): created successfully Apr 25 15:56:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1401d56a-6cea-42bf-ad7f-7a623b679212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] Flow 'volume_create_manager' (adec19c5-e8b1-4524-8acb-0df684d9a833) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:56:29 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-c7c08d69-a211-460b-8a99-a3f8e1475c5f tempest-SnapshotMetadataTestJSON-1437704514 None] Created volume successfully. Apr 25 15:56:29 devstack sudo[89543]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-36719761-3d1f-4534-b8d5-86d8c4b6dd72 tempest-SnapshotDependencyTests-1706104321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93" returned: 0 in 0.515s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-36719761-3d1f-4534-b8d5-86d8c4b6dd72 tempest-SnapshotDependencyTests-1706104321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93.5be5a309-1b1d-43a3-a613-d7f094605521 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:29 devstack sudo[89549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93.5be5a309-1b1d-43a3-a613-d7f094605521 Apr 25 15:56:29 devstack sudo[89549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-caedd600-b269-4a01-a125-82ebc0005f67 tempest-SnapshotMetadataTestJSON-1437704514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:56:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-caedd600-b269-4a01-a125-82ebc0005f67 tempest-SnapshotMetadataTestJSON-1437704514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:56:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-caedd600-b269-4a01-a125-82ebc0005f67 tempest-SnapshotMetadataTestJSON-1437704514 None] Creating offline snapshot 5529e264-93d1-4531-a8b6-1f8c902a4ef7 of volume 3f0f1fd6-3f70-4171-8a31-058b30907137 {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 15:56:30 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3a4581-a3ac-4ecf-9f33-b9ac559d51d3]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:56:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-caedd600-b269-4a01-a125-82ebc0005f67 tempest-SnapshotMetadataTestJSON-1437704514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:30 devstack sudo[89551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137 Apr 25 15:56:30 devstack sudo[89551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:30 devstack sudo[89549]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-36719761-3d1f-4534-b8d5-86d8c4b6dd72 tempest-SnapshotDependencyTests-1706104321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93.5be5a309-1b1d-43a3-a613-d7f094605521" returned: 0 in 0.545s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-36719761-3d1f-4534-b8d5-86d8c4b6dd72 tempest-SnapshotDependencyTests-1706104321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93.5be5a309-1b1d-43a3-a613-d7f094605521 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:30 devstack sudo[89556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93.5be5a309-1b1d-43a3-a613-d7f094605521 Apr 25 15:56:30 devstack sudo[89556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:30 devstack sudo[89551]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-caedd600-b269-4a01-a125-82ebc0005f67 tempest-SnapshotMetadataTestJSON-1437704514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137" returned: 0 in 0.545s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-caedd600-b269-4a01-a125-82ebc0005f67 tempest-SnapshotMetadataTestJSON-1437704514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137.5529e264-93d1-4531-a8b6-1f8c902a4ef7 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:30 devstack sudo[89561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137.5529e264-93d1-4531-a8b6-1f8c902a4ef7 1G Apr 25 15:56:30 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:30 devstack sudo[89556]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-36719761-3d1f-4534-b8d5-86d8c4b6dd72 tempest-SnapshotDependencyTests-1706104321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93.5be5a309-1b1d-43a3-a613-d7f094605521" returned: 0 in 0.452s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:30 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-36719761-3d1f-4534-b8d5-86d8c4b6dd72 tempest-SnapshotDependencyTests-1706104321 None] Lock "cinder-quobyte-5be5a309-1b1d-43a3-a613-d7f094605521" released by "_delete_snapshot" :: held 2.155s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:56:30 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-36719761-3d1f-4534-b8d5-86d8c4b6dd72 tempest-SnapshotDependencyTests-1706104321 None] Lock "cinder-quobyte-12fb8f43-7da9-47bf-9585-656fbf758f93" released by "delete_snapshot" :: held 2.182s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:56:30 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-36719761-3d1f-4534-b8d5-86d8c4b6dd72 tempest-SnapshotDependencyTests-1706104321 None] Created reservations ['2861a42f-1f54-4a62-9be4-35bea6728db2', '7b5952a6-77d8-4532-8faa-d98dcb7a8ddf', '261fb0e1-39dd-4315-a65b-49ff42f27500', 'e0786fbf-dc97-4ac1-a4e7-0636adc45d4e'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:56:31 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-36719761-3d1f-4534-b8d5-86d8c4b6dd72 tempest-SnapshotDependencyTests-1706104321 None] Delete snapshot completed successfully. Apr 25 15:56:31 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-36719761-3d1f-4534-b8d5-86d8c4b6dd72 tempest-SnapshotDependencyTests-1706104321 None] Lock "cinder-5be5a309-1b1d-43a3-a613-d7f094605521-delete_snapshot" released by "delete_snapshot" :: held 2.328s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:56:31 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-caedd600-b269-4a01-a125-82ebc0005f67 tempest-SnapshotMetadataTestJSON-1437704514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137.5529e264-93d1-4531-a8b6-1f8c902a4ef7 1G" returned: 0 in 0.668s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-caedd600-b269-4a01-a125-82ebc0005f67 tempest-SnapshotMetadataTestJSON-1437704514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f0f1fd6-3f70-4171-8a31-058b30907137 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137.5529e264-93d1-4531-a8b6-1f8c902a4ef7 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:31 devstack sudo[89570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f0f1fd6-3f70-4171-8a31-058b30907137 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137.5529e264-93d1-4531-a8b6-1f8c902a4ef7 Apr 25 15:56:31 devstack sudo[89570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:31 devstack sudo[89570]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-caedd600-b269-4a01-a125-82ebc0005f67 tempest-SnapshotMetadataTestJSON-1437704514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f0f1fd6-3f70-4171-8a31-058b30907137 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137.5529e264-93d1-4531-a8b6-1f8c902a4ef7" returned: 0 in 0.487s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:31 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-caedd600-b269-4a01-a125-82ebc0005f67 tempest-SnapshotMetadataTestJSON-1437704514 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137.5529e264-93d1-4531-a8b6-1f8c902a4ef7 is being set with open permissions: ugo+rw Apr 25 15:56:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-caedd600-b269-4a01-a125-82ebc0005f67 tempest-SnapshotMetadataTestJSON-1437704514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137.5529e264-93d1-4531-a8b6-1f8c902a4ef7 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:31 devstack sudo[89575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137.5529e264-93d1-4531-a8b6-1f8c902a4ef7 Apr 25 15:56:31 devstack sudo[89575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:31 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-86004482-28dd-4eb1-9460-66dcab559f5c tempest-SnapshotDependencyTests-1706104321 None] Acquiring lock "cinder-12fb8f43-7da9-47bf-9585-656fbf758f93-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:56:31 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-86004482-28dd-4eb1-9460-66dcab559f5c tempest-SnapshotDependencyTests-1706104321 None] Lock "cinder-12fb8f43-7da9-47bf-9585-656fbf758f93-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:56:31 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-86004482-28dd-4eb1-9460-66dcab559f5c tempest-SnapshotDependencyTests-1706104321 None] Acquiring lock "cinder-quobyte-12fb8f43-7da9-47bf-9585-656fbf758f93" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:56:31 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-86004482-28dd-4eb1-9460-66dcab559f5c tempest-SnapshotDependencyTests-1706104321 None] Lock "cinder-quobyte-12fb8f43-7da9-47bf-9585-656fbf758f93" acquired by "delete_volume" :: waited 0.012s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:56:31 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[99dccdbf-17bb-4043-b1e7-ba59bb7b9452]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:56:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-86004482-28dd-4eb1-9460-66dcab559f5c tempest-SnapshotDependencyTests-1706104321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:32 devstack sudo[89577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93 Apr 25 15:56:32 devstack sudo[89577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:32 devstack sudo[89575]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-caedd600-b269-4a01-a125-82ebc0005f67 tempest-SnapshotMetadataTestJSON-1437704514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137.5529e264-93d1-4531-a8b6-1f8c902a4ef7" returned: 0 in 0.481s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-caedd600-b269-4a01-a125-82ebc0005f67 tempest-SnapshotMetadataTestJSON-1437704514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:32 devstack sudo[89580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137.info Apr 25 15:56:32 devstack sudo[89580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:32 devstack sudo[89577]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-86004482-28dd-4eb1-9460-66dcab559f5c tempest-SnapshotDependencyTests-1706104321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93" returned: 0 in 0.552s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-86004482-28dd-4eb1-9460-66dcab559f5c tempest-SnapshotDependencyTests-1706104321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:32 devstack sudo[89585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93 Apr 25 15:56:32 devstack sudo[89585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:32 devstack sudo[89580]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-caedd600-b269-4a01-a125-82ebc0005f67 tempest-SnapshotMetadataTestJSON-1437704514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137.info" returned: 0 in 0.469s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:32 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-caedd600-b269-4a01-a125-82ebc0005f67 tempest-SnapshotMetadataTestJSON-1437704514 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137.info is being set with open permissions: ugo+rw Apr 25 15:56:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-caedd600-b269-4a01-a125-82ebc0005f67 tempest-SnapshotMetadataTestJSON-1437704514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:32 devstack sudo[89588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137.info Apr 25 15:56:32 devstack sudo[89588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:33 devstack sudo[89585]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-86004482-28dd-4eb1-9460-66dcab559f5c tempest-SnapshotDependencyTests-1706104321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-12fb8f43-7da9-47bf-9585-656fbf758f93" returned: 0 in 0.456s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:33 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-86004482-28dd-4eb1-9460-66dcab559f5c tempest-SnapshotDependencyTests-1706104321 None] Lock "cinder-quobyte-12fb8f43-7da9-47bf-9585-656fbf758f93" released by "delete_volume" :: held 1.065s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:56:33 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-86004482-28dd-4eb1-9460-66dcab559f5c tempest-SnapshotDependencyTests-1706104321 None] Created reservations ['c851bd56-71b0-4872-8849-08ca168d2b72', '205ce5fa-1fd5-422d-a8d5-1e56298a8173', 'baf7f09b-e73d-4f14-97a3-67e4316eb8c7', 'c56fd54d-9b84-41b0-ab53-7b37039eb4e0'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:56:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-86004482-28dd-4eb1-9460-66dcab559f5c tempest-SnapshotDependencyTests-1706104321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:56:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-86004482-28dd-4eb1-9460-66dcab559f5c tempest-SnapshotDependencyTests-1706104321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:56:33 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-86004482-28dd-4eb1-9460-66dcab559f5c tempest-SnapshotDependencyTests-1706104321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:56:33 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-86004482-28dd-4eb1-9460-66dcab559f5c tempest-SnapshotDependencyTests-1706104321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:56:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-86004482-28dd-4eb1-9460-66dcab559f5c tempest-SnapshotDependencyTests-1706104321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:56:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-86004482-28dd-4eb1-9460-66dcab559f5c tempest-SnapshotDependencyTests-1706104321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:33 devstack sudo[89591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:56:33 devstack sudo[89591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:33 devstack sudo[89588]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-caedd600-b269-4a01-a125-82ebc0005f67 tempest-SnapshotMetadataTestJSON-1437704514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137.info" returned: 0 in 0.489s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-caedd600-b269-4a01-a125-82ebc0005f67 tempest-SnapshotMetadataTestJSON-1437704514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.225s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:56:33 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-caedd600-b269-4a01-a125-82ebc0005f67 tempest-SnapshotMetadataTestJSON-1437704514 None] Create snapshot completed successfully Apr 25 15:56:33 devstack sudo[89591]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-86004482-28dd-4eb1-9460-66dcab559f5c tempest-SnapshotDependencyTests-1706104321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.423s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:33 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-86004482-28dd-4eb1-9460-66dcab559f5c tempest-SnapshotDependencyTests-1706104321 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:56:33 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-86004482-28dd-4eb1-9460-66dcab559f5c tempest-SnapshotDependencyTests-1706104321 None] Deleted volume successfully. Apr 25 15:56:33 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-86004482-28dd-4eb1-9460-66dcab559f5c tempest-SnapshotDependencyTests-1706104321 None] Lock "cinder-12fb8f43-7da9-47bf-9585-656fbf758f93-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:56:34 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d39a719c-2827-4b92-b2e4-fd6274192aab tempest-SnapshotDependencyTests-1706104321 None] Acquiring lock "cinder-bf35b0a2-eee3-4f8f-b5c4-8d432252326f-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:56:34 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d39a719c-2827-4b92-b2e4-fd6274192aab tempest-SnapshotDependencyTests-1706104321 None] Lock "cinder-bf35b0a2-eee3-4f8f-b5c4-8d432252326f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:56:34 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d39a719c-2827-4b92-b2e4-fd6274192aab tempest-SnapshotDependencyTests-1706104321 None] Acquiring lock "cinder-quobyte-bf35b0a2-eee3-4f8f-b5c4-8d432252326f" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:56:34 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d39a719c-2827-4b92-b2e4-fd6274192aab tempest-SnapshotDependencyTests-1706104321 None] Lock "cinder-quobyte-bf35b0a2-eee3-4f8f-b5c4-8d432252326f" acquired by "delete_volume" :: waited 0.015s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:56:34 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46c8e3b-ab04-4899-8632-fb1b289d20fa]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:56:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d39a719c-2827-4b92-b2e4-fd6274192aab tempest-SnapshotDependencyTests-1706104321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bf35b0a2-eee3-4f8f-b5c4-8d432252326f {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:34 devstack sudo[89595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bf35b0a2-eee3-4f8f-b5c4-8d432252326f Apr 25 15:56:34 devstack sudo[89595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:34 devstack sudo[89595]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d39a719c-2827-4b92-b2e4-fd6274192aab tempest-SnapshotDependencyTests-1706104321 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bf35b0a2-eee3-4f8f-b5c4-8d432252326f" returned: 0 in 0.601s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d39a719c-2827-4b92-b2e4-fd6274192aab tempest-SnapshotDependencyTests-1706104321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bf35b0a2-eee3-4f8f-b5c4-8d432252326f {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:34 devstack sudo[89600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bf35b0a2-eee3-4f8f-b5c4-8d432252326f Apr 25 15:56:34 devstack sudo[89600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:34 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-02161d00-d243-44af-a7e2-8bbe5e0c2457 tempest-SnapshotMetadataTestJSON-1437704514 None] Acquiring lock "cinder-5529e264-93d1-4531-a8b6-1f8c902a4ef7-delete_snapshot" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:56:34 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-02161d00-d243-44af-a7e2-8bbe5e0c2457 tempest-SnapshotMetadataTestJSON-1437704514 None] Lock "cinder-5529e264-93d1-4531-a8b6-1f8c902a4ef7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:56:34 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-02161d00-d243-44af-a7e2-8bbe5e0c2457 tempest-SnapshotMetadataTestJSON-1437704514 None] Acquiring lock "cinder-quobyte-3f0f1fd6-3f70-4171-8a31-058b30907137" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:56:35 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-02161d00-d243-44af-a7e2-8bbe5e0c2457 tempest-SnapshotMetadataTestJSON-1437704514 None] Lock "cinder-quobyte-3f0f1fd6-3f70-4171-8a31-058b30907137" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:56:35 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-02161d00-d243-44af-a7e2-8bbe5e0c2457 tempest-SnapshotMetadataTestJSON-1437704514 None] Acquiring lock "cinder-quobyte-5529e264-93d1-4531-a8b6-1f8c902a4ef7" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:56:35 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-02161d00-d243-44af-a7e2-8bbe5e0c2457 tempest-SnapshotMetadataTestJSON-1437704514 None] Lock "cinder-quobyte-5529e264-93d1-4531-a8b6-1f8c902a4ef7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:56:35 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-02161d00-d243-44af-a7e2-8bbe5e0c2457 tempest-SnapshotMetadataTestJSON-1437704514 None] Deleting offline snapshot 5529e264-93d1-4531-a8b6-1f8c902a4ef7 of volume 3f0f1fd6-3f70-4171-8a31-058b30907137 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 15:56:35 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-02161d00-d243-44af-a7e2-8bbe5e0c2457 tempest-SnapshotMetadataTestJSON-1437704514 None] snapshot_file for this snap is: volume-3f0f1fd6-3f70-4171-8a31-058b30907137.5529e264-93d1-4531-a8b6-1f8c902a4ef7 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 15:56:35 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[352462ec-a49d-4a8c-8a9b-dca62be56bd6]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:56:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-02161d00-d243-44af-a7e2-8bbe5e0c2457 tempest-SnapshotMetadataTestJSON-1437704514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137.5529e264-93d1-4531-a8b6-1f8c902a4ef7 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:35 devstack sudo[89602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137.5529e264-93d1-4531-a8b6-1f8c902a4ef7 Apr 25 15:56:35 devstack sudo[89602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:35 devstack sudo[89600]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d39a719c-2827-4b92-b2e4-fd6274192aab tempest-SnapshotDependencyTests-1706104321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bf35b0a2-eee3-4f8f-b5c4-8d432252326f" returned: 0 in 0.488s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:35 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d39a719c-2827-4b92-b2e4-fd6274192aab tempest-SnapshotDependencyTests-1706104321 None] Lock "cinder-quobyte-bf35b0a2-eee3-4f8f-b5c4-8d432252326f" released by "delete_volume" :: held 1.133s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:56:35 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-d39a719c-2827-4b92-b2e4-fd6274192aab tempest-SnapshotDependencyTests-1706104321 None] Created reservations ['df3ab37c-b2d7-42c3-b262-5abdc308316c', '56580bae-fe95-4f57-a2eb-9adf8bb94047', '9ff2e3e1-cbf5-4bda-9016-2c75c6443880', '21464193-8bcc-45f0-8682-6c03c7ab8cf1'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:56:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d39a719c-2827-4b92-b2e4-fd6274192aab tempest-SnapshotDependencyTests-1706104321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:56:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d39a719c-2827-4b92-b2e4-fd6274192aab tempest-SnapshotDependencyTests-1706104321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:56:35 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d39a719c-2827-4b92-b2e4-fd6274192aab tempest-SnapshotDependencyTests-1706104321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:56:35 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d39a719c-2827-4b92-b2e4-fd6274192aab tempest-SnapshotDependencyTests-1706104321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:56:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d39a719c-2827-4b92-b2e4-fd6274192aab tempest-SnapshotDependencyTests-1706104321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:56:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d39a719c-2827-4b92-b2e4-fd6274192aab tempest-SnapshotDependencyTests-1706104321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:35 devstack sudo[89605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:56:35 devstack sudo[89605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:35 devstack sudo[89602]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-02161d00-d243-44af-a7e2-8bbe5e0c2457 tempest-SnapshotMetadataTestJSON-1437704514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137.5529e264-93d1-4531-a8b6-1f8c902a4ef7" returned: 0 in 0.550s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:35 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-02161d00-d243-44af-a7e2-8bbe5e0c2457 tempest-SnapshotMetadataTestJSON-1437704514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f0f1fd6-3f70-4171-8a31-058b30907137(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:56:35 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[70aa5c86-8b09-4cfb-8ded-0cec0fc586c5]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:56:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-02161d00-d243-44af-a7e2-8bbe5e0c2457 tempest-SnapshotMetadataTestJSON-1437704514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:35 devstack sudo[89610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137 Apr 25 15:56:35 devstack sudo[89610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:35 devstack sudo[89605]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d39a719c-2827-4b92-b2e4-fd6274192aab tempest-SnapshotDependencyTests-1706104321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.432s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:35 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-d39a719c-2827-4b92-b2e4-fd6274192aab tempest-SnapshotDependencyTests-1706104321 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:56:35 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-d39a719c-2827-4b92-b2e4-fd6274192aab tempest-SnapshotDependencyTests-1706104321 None] Deleted volume successfully. Apr 25 15:56:35 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d39a719c-2827-4b92-b2e4-fd6274192aab tempest-SnapshotDependencyTests-1706104321 None] Lock "cinder-bf35b0a2-eee3-4f8f-b5c4-8d432252326f-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:56:36 devstack sudo[89610]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-02161d00-d243-44af-a7e2-8bbe5e0c2457 tempest-SnapshotMetadataTestJSON-1437704514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137" returned: 0 in 0.515s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-02161d00-d243-44af-a7e2-8bbe5e0c2457 tempest-SnapshotMetadataTestJSON-1437704514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137.5529e264-93d1-4531-a8b6-1f8c902a4ef7 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:36 devstack sudo[89616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137.5529e264-93d1-4531-a8b6-1f8c902a4ef7 Apr 25 15:56:36 devstack sudo[89616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:36 devstack sudo[89616]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-02161d00-d243-44af-a7e2-8bbe5e0c2457 tempest-SnapshotMetadataTestJSON-1437704514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137.5529e264-93d1-4531-a8b6-1f8c902a4ef7" returned: 0 in 0.557s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-02161d00-d243-44af-a7e2-8bbe5e0c2457 tempest-SnapshotMetadataTestJSON-1437704514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137.5529e264-93d1-4531-a8b6-1f8c902a4ef7 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:36 devstack sudo[89621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137.5529e264-93d1-4531-a8b6-1f8c902a4ef7 Apr 25 15:56:36 devstack sudo[89621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:37 devstack sudo[89621]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-02161d00-d243-44af-a7e2-8bbe5e0c2457 tempest-SnapshotMetadataTestJSON-1437704514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137.5529e264-93d1-4531-a8b6-1f8c902a4ef7" returned: 0 in 0.457s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:37 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-02161d00-d243-44af-a7e2-8bbe5e0c2457 tempest-SnapshotMetadataTestJSON-1437704514 None] Lock "cinder-quobyte-5529e264-93d1-4531-a8b6-1f8c902a4ef7" released by "_delete_snapshot" :: held 2.182s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:56:37 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-02161d00-d243-44af-a7e2-8bbe5e0c2457 tempest-SnapshotMetadataTestJSON-1437704514 None] Lock "cinder-quobyte-3f0f1fd6-3f70-4171-8a31-058b30907137" released by "delete_snapshot" :: held 2.207s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:56:37 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-02161d00-d243-44af-a7e2-8bbe5e0c2457 tempest-SnapshotMetadataTestJSON-1437704514 None] Created reservations ['873330f6-036a-476a-aff9-468b21174c13', '0c79f9b0-8813-4456-af9e-4605a28e9c20', '37dc087b-2671-476e-9c50-bb0406ad9dc3', 'e67fdd16-7831-4757-aa82-b763dde50fc3'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:56:37 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-02161d00-d243-44af-a7e2-8bbe5e0c2457 tempest-SnapshotMetadataTestJSON-1437704514 None] Delete snapshot completed successfully. Apr 25 15:56:37 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-02161d00-d243-44af-a7e2-8bbe5e0c2457 tempest-SnapshotMetadataTestJSON-1437704514 None] Lock "cinder-5529e264-93d1-4531-a8b6-1f8c902a4ef7-delete_snapshot" released by "delete_snapshot" :: held 2.341s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:56:38 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-cef4f91b-ff8f-4254-863f-1fbf68063091 tempest-SnapshotMetadataTestJSON-1437704514 None] Acquiring lock "cinder-3f0f1fd6-3f70-4171-8a31-058b30907137-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:56:38 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-cef4f91b-ff8f-4254-863f-1fbf68063091 tempest-SnapshotMetadataTestJSON-1437704514 None] Lock "cinder-3f0f1fd6-3f70-4171-8a31-058b30907137-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:56:38 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-cef4f91b-ff8f-4254-863f-1fbf68063091 tempest-SnapshotMetadataTestJSON-1437704514 None] Acquiring lock "cinder-quobyte-3f0f1fd6-3f70-4171-8a31-058b30907137" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:56:38 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-cef4f91b-ff8f-4254-863f-1fbf68063091 tempest-SnapshotMetadataTestJSON-1437704514 None] Lock "cinder-quobyte-3f0f1fd6-3f70-4171-8a31-058b30907137" acquired by "delete_volume" :: waited 0.018s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:56:38 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[41178f77-6d68-4c72-9096-96ea5dc75c12]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:56:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-cef4f91b-ff8f-4254-863f-1fbf68063091 tempest-SnapshotMetadataTestJSON-1437704514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:38 devstack sudo[89625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137 Apr 25 15:56:38 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:38 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-cef4f91b-ff8f-4254-863f-1fbf68063091 tempest-SnapshotMetadataTestJSON-1437704514 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137" returned: 0 in 0.592s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-cef4f91b-ff8f-4254-863f-1fbf68063091 tempest-SnapshotMetadataTestJSON-1437704514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:38 devstack sudo[89630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137 Apr 25 15:56:38 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:39 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-cef4f91b-ff8f-4254-863f-1fbf68063091 tempest-SnapshotMetadataTestJSON-1437704514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-3f0f1fd6-3f70-4171-8a31-058b30907137" returned: 0 in 0.486s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:39 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-cef4f91b-ff8f-4254-863f-1fbf68063091 tempest-SnapshotMetadataTestJSON-1437704514 None] Lock "cinder-quobyte-3f0f1fd6-3f70-4171-8a31-058b30907137" released by "delete_volume" :: held 1.149s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:56:39 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-cef4f91b-ff8f-4254-863f-1fbf68063091 tempest-SnapshotMetadataTestJSON-1437704514 None] Created reservations ['bade28f1-1a78-4a2a-b0b4-204e166b60bc', 'c5cc3706-8e0c-4a8c-9865-19d20c91fa8b', '966f2a0c-bae9-4358-8b01-f5c855eeb45a', '2897c8ad-0d45-43bd-b47a-8d6e2bfc6306'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:56:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-cef4f91b-ff8f-4254-863f-1fbf68063091 tempest-SnapshotMetadataTestJSON-1437704514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:56:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-cef4f91b-ff8f-4254-863f-1fbf68063091 tempest-SnapshotMetadataTestJSON-1437704514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:56:39 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-cef4f91b-ff8f-4254-863f-1fbf68063091 tempest-SnapshotMetadataTestJSON-1437704514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:56:39 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-cef4f91b-ff8f-4254-863f-1fbf68063091 tempest-SnapshotMetadataTestJSON-1437704514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:56:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-cef4f91b-ff8f-4254-863f-1fbf68063091 tempest-SnapshotMetadataTestJSON-1437704514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:56:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-cef4f91b-ff8f-4254-863f-1fbf68063091 tempest-SnapshotMetadataTestJSON-1437704514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:39 devstack sudo[89634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:56:39 devstack sudo[89634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:39 devstack sudo[89634]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-cef4f91b-ff8f-4254-863f-1fbf68063091 tempest-SnapshotMetadataTestJSON-1437704514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.460s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:40 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-cef4f91b-ff8f-4254-863f-1fbf68063091 tempest-SnapshotMetadataTestJSON-1437704514 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:56:40 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-cef4f91b-ff8f-4254-863f-1fbf68063091 tempest-SnapshotMetadataTestJSON-1437704514 None] Deleted volume successfully. Apr 25 15:56:40 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-cef4f91b-ff8f-4254-863f-1fbf68063091 tempest-SnapshotMetadataTestJSON-1437704514 None] Lock "cinder-3f0f1fd6-3f70-4171-8a31-058b30907137-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:56:43 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:56:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] Flow 'volume_create_manager' (30f52c1f-3702-4850-95e2-e29436e90c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:56:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e0ab11-4708-4796-af20-56f640f3441a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e0ab11-4708-4796-af20-56f640f3441a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1440916487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ca3845-0e97-48d2-91e8-e41620552d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5965b9638f9b4879b25b3b7f58702573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:56:43Z,use_quota=True,user_id='9c0b2907d6c54acdbabe85a7cc54f854',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce6c41d5-ab36-414a-b4f6-958b63f9e1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce6c41d5-ab36-414a-b4f6-958b63f9e1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67498599-c89d-4b28-82ac-c356fbe657a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67498599-c89d-4b28-82ac-c356fbe657a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2ca3845-0e97-48d2-91e8-e41620552d30', 'volume_name': 'volume-a2ca3845-0e97-48d2-91e8-e41620552d30', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bea8579-52c6-4a36-bf8d-ab8e2cd79a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bea8579-52c6-4a36-bf8d-ab8e2cd79a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8d1a17-70a6-4e32-a7d1-e78562bf5372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:43 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] Volume a2ca3845-0e97-48d2-91e8-e41620552d30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2ca3845-0e97-48d2-91e8-e41620552d30', 'volume_size': 1} Apr 25 15:56:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:56:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:56:43 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1440916487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ca3845-0e97-48d2-91e8-e41620552d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5965b9638f9b4879b25b3b7f58702573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:56:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:56:43Z,use_quota=True,user_id='9c0b2907d6c54acdbabe85a7cc54f854',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:56:43 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] Creating volume a2ca3845-0e97-48d2-91e8-e41620552d30 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:56:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:56:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:56:43 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:56:43 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:56:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:56:43 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:56:43 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:56:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:43 devstack sudo[89641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30 1073741824 Apr 25 15:56:43 devstack sudo[89641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:43 devstack sudo[89641]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30 1073741824" returned: 0 in 0.686s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:43 devstack sudo[89648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30 Apr 25 15:56:43 devstack sudo[89648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:44 devstack sudo[89648]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30" returned: 0 in 0.512s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:56:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:56:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8d1a17-70a6-4e32-a7d1-e78562bf5372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2ca3845-0e97-48d2-91e8-e41620552d30', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (124e1c31-dd01-45a9-ba4b-5abbc300c52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:44 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] Volume volume-a2ca3845-0e97-48d2-91e8-e41620552d30 (a2ca3845-0e97-48d2-91e8-e41620552d30): created successfully Apr 25 15:56:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (124e1c31-dd01-45a9-ba4b-5abbc300c52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] Flow 'volume_create_manager' (30f52c1f-3702-4850-95e2-e29436e90c52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:56:44 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-bdf56a1e-ce40-4b99-9023-02679ad69f73 tempest-VolumesDeleteCascade-746622713 None] Created volume successfully. Apr 25 15:56:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-22fba35a-0a30-440d-a136-1a99b2013b2e tempest-VolumesDeleteCascade-746622713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:56:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-22fba35a-0a30-440d-a136-1a99b2013b2e tempest-VolumesDeleteCascade-746622713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:56:45 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-22fba35a-0a30-440d-a136-1a99b2013b2e tempest-VolumesDeleteCascade-746622713 None] Creating offline snapshot c6c5db99-7838-4abc-866e-10f4f0b51e5e of volume a2ca3845-0e97-48d2-91e8-e41620552d30 {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 15:56:45 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5eaa38-97a2-49d2-bee8-bd4d933e244c]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:56:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22fba35a-0a30-440d-a136-1a99b2013b2e tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:45 devstack sudo[89651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30 Apr 25 15:56:45 devstack sudo[89651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:45 devstack sudo[89651]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22fba35a-0a30-440d-a136-1a99b2013b2e tempest-VolumesDeleteCascade-746622713 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30" returned: 0 in 0.502s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22fba35a-0a30-440d-a136-1a99b2013b2e tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.c6c5db99-7838-4abc-866e-10f4f0b51e5e 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:45 devstack sudo[89656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.c6c5db99-7838-4abc-866e-10f4f0b51e5e 1G Apr 25 15:56:45 devstack sudo[89656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:46 devstack sudo[89656]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22fba35a-0a30-440d-a136-1a99b2013b2e tempest-VolumesDeleteCascade-746622713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.c6c5db99-7838-4abc-866e-10f4f0b51e5e 1G" returned: 0 in 0.587s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22fba35a-0a30-440d-a136-1a99b2013b2e tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ca3845-0e97-48d2-91e8-e41620552d30 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.c6c5db99-7838-4abc-866e-10f4f0b51e5e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:46 devstack sudo[89661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ca3845-0e97-48d2-91e8-e41620552d30 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.c6c5db99-7838-4abc-866e-10f4f0b51e5e Apr 25 15:56:46 devstack sudo[89661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:46 devstack sudo[89661]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22fba35a-0a30-440d-a136-1a99b2013b2e tempest-VolumesDeleteCascade-746622713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ca3845-0e97-48d2-91e8-e41620552d30 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.c6c5db99-7838-4abc-866e-10f4f0b51e5e" returned: 0 in 0.457s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:46 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-22fba35a-0a30-440d-a136-1a99b2013b2e tempest-VolumesDeleteCascade-746622713 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.c6c5db99-7838-4abc-866e-10f4f0b51e5e is being set with open permissions: ugo+rw Apr 25 15:56:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22fba35a-0a30-440d-a136-1a99b2013b2e tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.c6c5db99-7838-4abc-866e-10f4f0b51e5e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:46 devstack sudo[89666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.c6c5db99-7838-4abc-866e-10f4f0b51e5e Apr 25 15:56:46 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:47 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22fba35a-0a30-440d-a136-1a99b2013b2e tempest-VolumesDeleteCascade-746622713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.c6c5db99-7838-4abc-866e-10f4f0b51e5e" returned: 0 in 0.456s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22fba35a-0a30-440d-a136-1a99b2013b2e tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:47 devstack sudo[89669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.info Apr 25 15:56:47 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:47 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22fba35a-0a30-440d-a136-1a99b2013b2e tempest-VolumesDeleteCascade-746622713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.info" returned: 0 in 0.452s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:47 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-22fba35a-0a30-440d-a136-1a99b2013b2e tempest-VolumesDeleteCascade-746622713 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.info is being set with open permissions: ugo+rw Apr 25 15:56:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22fba35a-0a30-440d-a136-1a99b2013b2e tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:47 devstack sudo[89672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.info Apr 25 15:56:47 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:48 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22fba35a-0a30-440d-a136-1a99b2013b2e tempest-VolumesDeleteCascade-746622713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.info" returned: 0 in 0.413s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-22fba35a-0a30-440d-a136-1a99b2013b2e tempest-VolumesDeleteCascade-746622713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.956s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:56:48 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-22fba35a-0a30-440d-a136-1a99b2013b2e tempest-VolumesDeleteCascade-746622713 None] Create snapshot completed successfully Apr 25 15:56:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ec97e465-6ca7-444d-b376-e2ad7dd92148 tempest-VolumesDeleteCascade-746622713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:56:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ec97e465-6ca7-444d-b376-e2ad7dd92148 tempest-VolumesDeleteCascade-746622713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:56:48 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-ec97e465-6ca7-444d-b376-e2ad7dd92148 tempest-VolumesDeleteCascade-746622713 None] Creating offline snapshot 6e3d5f6b-a5f9-4b1e-8a09-5ac7f0ad1288 of volume a2ca3845-0e97-48d2-91e8-e41620552d30 {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 15:56:48 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4326012-72c9-4c50-b601-54b6794c2a57]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:56:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ec97e465-6ca7-444d-b376-e2ad7dd92148 tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.c6c5db99-7838-4abc-866e-10f4f0b51e5e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:48 devstack sudo[89675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.c6c5db99-7838-4abc-866e-10f4f0b51e5e Apr 25 15:56:48 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:49 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ec97e465-6ca7-444d-b376-e2ad7dd92148 tempest-VolumesDeleteCascade-746622713 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.c6c5db99-7838-4abc-866e-10f4f0b51e5e" returned: 0 in 0.488s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:49 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-ec97e465-6ca7-444d-b376-e2ad7dd92148 tempest-VolumesDeleteCascade-746622713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2ca3845-0e97-48d2-91e8-e41620552d30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:56:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ec97e465-6ca7-444d-b376-e2ad7dd92148 tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.c6c5db99-7838-4abc-866e-10f4f0b51e5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.6e3d5f6b-a5f9-4b1e-8a09-5ac7f0ad1288 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:49 devstack sudo[89680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.c6c5db99-7838-4abc-866e-10f4f0b51e5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.6e3d5f6b-a5f9-4b1e-8a09-5ac7f0ad1288 1G Apr 25 15:56:49 devstack sudo[89680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:49 devstack sudo[89680]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ec97e465-6ca7-444d-b376-e2ad7dd92148 tempest-VolumesDeleteCascade-746622713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.c6c5db99-7838-4abc-866e-10f4f0b51e5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.6e3d5f6b-a5f9-4b1e-8a09-5ac7f0ad1288 1G" returned: 0 in 0.601s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ec97e465-6ca7-444d-b376-e2ad7dd92148 tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ca3845-0e97-48d2-91e8-e41620552d30.c6c5db99-7838-4abc-866e-10f4f0b51e5e -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.6e3d5f6b-a5f9-4b1e-8a09-5ac7f0ad1288 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:49 devstack sudo[89685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ca3845-0e97-48d2-91e8-e41620552d30.c6c5db99-7838-4abc-866e-10f4f0b51e5e -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.6e3d5f6b-a5f9-4b1e-8a09-5ac7f0ad1288 Apr 25 15:56:49 devstack sudo[89685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:50 devstack sudo[89685]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ec97e465-6ca7-444d-b376-e2ad7dd92148 tempest-VolumesDeleteCascade-746622713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2ca3845-0e97-48d2-91e8-e41620552d30.c6c5db99-7838-4abc-866e-10f4f0b51e5e -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.6e3d5f6b-a5f9-4b1e-8a09-5ac7f0ad1288" returned: 0 in 0.448s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:50 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-ec97e465-6ca7-444d-b376-e2ad7dd92148 tempest-VolumesDeleteCascade-746622713 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.6e3d5f6b-a5f9-4b1e-8a09-5ac7f0ad1288 is being set with open permissions: ugo+rw Apr 25 15:56:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ec97e465-6ca7-444d-b376-e2ad7dd92148 tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.6e3d5f6b-a5f9-4b1e-8a09-5ac7f0ad1288 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:50 devstack sudo[89690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.6e3d5f6b-a5f9-4b1e-8a09-5ac7f0ad1288 Apr 25 15:56:50 devstack sudo[89690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:50 devstack sudo[89690]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ec97e465-6ca7-444d-b376-e2ad7dd92148 tempest-VolumesDeleteCascade-746622713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.6e3d5f6b-a5f9-4b1e-8a09-5ac7f0ad1288" returned: 0 in 0.426s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ec97e465-6ca7-444d-b376-e2ad7dd92148 tempest-VolumesDeleteCascade-746622713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.056s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:56:50 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-ec97e465-6ca7-444d-b376-e2ad7dd92148 tempest-VolumesDeleteCascade-746622713 None] Create snapshot completed successfully Apr 25 15:56:51 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Acquiring lock "cinder-a2ca3845-0e97-48d2-91e8-e41620552d30-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:56:51 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-a2ca3845-0e97-48d2-91e8-e41620552d30-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:56:51 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Performing cascade delete. {{(pid=81828) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 25 15:56:51 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Acquiring lock "cinder-6e3d5f6b-a5f9-4b1e-8a09-5ac7f0ad1288-delete_snapshot" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:56:51 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-6e3d5f6b-a5f9-4b1e-8a09-5ac7f0ad1288-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:56:51 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Acquiring lock "cinder-quobyte-a2ca3845-0e97-48d2-91e8-e41620552d30" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:56:51 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-quobyte-a2ca3845-0e97-48d2-91e8-e41620552d30" acquired by "delete_snapshot" :: waited 0.013s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:56:51 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Acquiring lock "cinder-quobyte-6e3d5f6b-a5f9-4b1e-8a09-5ac7f0ad1288" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:56:51 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-quobyte-6e3d5f6b-a5f9-4b1e-8a09-5ac7f0ad1288" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:56:51 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Deleting offline snapshot 6e3d5f6b-a5f9-4b1e-8a09-5ac7f0ad1288 of volume a2ca3845-0e97-48d2-91e8-e41620552d30 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 15:56:51 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] snapshot_file for this snap is: volume-a2ca3845-0e97-48d2-91e8-e41620552d30.6e3d5f6b-a5f9-4b1e-8a09-5ac7f0ad1288 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 15:56:51 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7db2c49-a9bc-4047-bea4-3e2ee2e34316]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:56:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.6e3d5f6b-a5f9-4b1e-8a09-5ac7f0ad1288 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:52 devstack sudo[89700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.6e3d5f6b-a5f9-4b1e-8a09-5ac7f0ad1288 Apr 25 15:56:52 devstack sudo[89700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:52 devstack sudo[89700]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.6e3d5f6b-a5f9-4b1e-8a09-5ac7f0ad1288" returned: 0 in 0.510s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:52 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2ca3845-0e97-48d2-91e8-e41620552d30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:56:52 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[088b0a27-59d8-4d9d-b372-38d97e14d0e3]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:56:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.c6c5db99-7838-4abc-866e-10f4f0b51e5e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:52 devstack sudo[89705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.c6c5db99-7838-4abc-866e-10f4f0b51e5e Apr 25 15:56:52 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:53 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.c6c5db99-7838-4abc-866e-10f4f0b51e5e" returned: 0 in 0.491s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:53 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2ca3845-0e97-48d2-91e8-e41620552d30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:56:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.6e3d5f6b-a5f9-4b1e-8a09-5ac7f0ad1288 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:53 devstack sudo[89710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.6e3d5f6b-a5f9-4b1e-8a09-5ac7f0ad1288 Apr 25 15:56:53 devstack sudo[89710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:53 devstack sudo[89710]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.6e3d5f6b-a5f9-4b1e-8a09-5ac7f0ad1288" returned: 0 in 0.566s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.6e3d5f6b-a5f9-4b1e-8a09-5ac7f0ad1288 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:53 devstack sudo[89715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.6e3d5f6b-a5f9-4b1e-8a09-5ac7f0ad1288 Apr 25 15:56:53 devstack sudo[89715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:54 devstack sudo[89715]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.6e3d5f6b-a5f9-4b1e-8a09-5ac7f0ad1288" returned: 0 in 0.437s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:54 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-quobyte-6e3d5f6b-a5f9-4b1e-8a09-5ac7f0ad1288" released by "_delete_snapshot" :: held 2.085s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:56:54 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-quobyte-a2ca3845-0e97-48d2-91e8-e41620552d30" released by "delete_snapshot" :: held 2.105s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:56:54 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Created reservations ['89170dcc-5656-437f-bcde-667f0e6ef213', '356447c6-3792-4647-adf9-bcdc962d2d7c', '8adae6bf-9eab-4d0c-b365-54f4c6a0da54', '6a3351df-c0b9-48a7-bc68-2bb48954da61'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:56:54 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Delete snapshot completed successfully. Apr 25 15:56:54 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-6e3d5f6b-a5f9-4b1e-8a09-5ac7f0ad1288-delete_snapshot" released by "delete_snapshot" :: held 2.237s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:56:54 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Acquiring lock "cinder-c6c5db99-7838-4abc-866e-10f4f0b51e5e-delete_snapshot" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:56:54 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-c6c5db99-7838-4abc-866e-10f4f0b51e5e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:56:54 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Acquiring lock "cinder-quobyte-a2ca3845-0e97-48d2-91e8-e41620552d30" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:56:54 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-quobyte-a2ca3845-0e97-48d2-91e8-e41620552d30" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:56:54 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Acquiring lock "cinder-quobyte-c6c5db99-7838-4abc-866e-10f4f0b51e5e" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:56:54 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-quobyte-c6c5db99-7838-4abc-866e-10f4f0b51e5e" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:56:54 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Deleting offline snapshot c6c5db99-7838-4abc-866e-10f4f0b51e5e of volume a2ca3845-0e97-48d2-91e8-e41620552d30 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 15:56:54 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] snapshot_file for this snap is: volume-a2ca3845-0e97-48d2-91e8-e41620552d30.c6c5db99-7838-4abc-866e-10f4f0b51e5e {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 15:56:54 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e8a95a-1aa9-4040-8577-9afb825e7684]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:56:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.c6c5db99-7838-4abc-866e-10f4f0b51e5e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:54 devstack sudo[89718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.c6c5db99-7838-4abc-866e-10f4f0b51e5e Apr 25 15:56:54 devstack sudo[89718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:54 devstack sudo[89718]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.c6c5db99-7838-4abc-866e-10f4f0b51e5e" returned: 0 in 0.514s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:54 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2ca3845-0e97-48d2-91e8-e41620552d30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:56:54 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[14db408d-bb5c-4426-8f28-3bf44de494a7]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:56:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:54 devstack sudo[89723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30 Apr 25 15:56:54 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:55 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30" returned: 0 in 0.508s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.c6c5db99-7838-4abc-866e-10f4f0b51e5e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:55 devstack sudo[89728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.c6c5db99-7838-4abc-866e-10f4f0b51e5e Apr 25 15:56:55 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:55 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.c6c5db99-7838-4abc-866e-10f4f0b51e5e" returned: 0 in 0.511s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.c6c5db99-7838-4abc-866e-10f4f0b51e5e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:55 devstack sudo[89733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.c6c5db99-7838-4abc-866e-10f4f0b51e5e Apr 25 15:56:55 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:56 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30.c6c5db99-7838-4abc-866e-10f4f0b51e5e" returned: 0 in 0.450s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:56 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-quobyte-c6c5db99-7838-4abc-866e-10f4f0b51e5e" released by "_delete_snapshot" :: held 2.071s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:56:56 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-quobyte-a2ca3845-0e97-48d2-91e8-e41620552d30" released by "delete_snapshot" :: held 2.090s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:56:56 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Created reservations ['e7f6479e-69c5-46c1-90cc-2b4e40d25fb7', '44eb1545-e2ec-4fde-88e3-ae23a869e2ef', 'c4c8f39f-274f-469d-9140-a9bc58dc39a1', '9e826650-4875-4bfc-b1e0-6ef934a52d28'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:56:56 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Delete snapshot completed successfully. Apr 25 15:56:56 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-c6c5db99-7838-4abc-866e-10f4f0b51e5e-delete_snapshot" released by "delete_snapshot" :: held 2.285s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:56:56 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Snapshots deleted, issuing volume delete {{(pid=81828) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 25 15:56:56 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Acquiring lock "cinder-quobyte-a2ca3845-0e97-48d2-91e8-e41620552d30" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:56:56 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-quobyte-a2ca3845-0e97-48d2-91e8-e41620552d30" acquired by "delete_volume" :: waited 0.015s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:56:56 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b57758d-8b73-4f1a-b382-33610579baa8]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:56:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:56 devstack sudo[89736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30 Apr 25 15:56:56 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:56 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30" returned: 0 in 0.484s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:57 devstack sudo[89741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30 Apr 25 15:56:57 devstack sudo[89741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:57 devstack sudo[89741]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a2ca3845-0e97-48d2-91e8-e41620552d30" returned: 0 in 0.422s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:57 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-quobyte-a2ca3845-0e97-48d2-91e8-e41620552d30" released by "delete_volume" :: held 0.962s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:56:57 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Created reservations ['9fa552a8-7fb8-489b-b631-d07ae80d0d61', '3aab6061-7a99-4cff-9e2b-e398d68e93fb', 'fc5fd890-aea6-4f3f-a1d9-f8116d3439d3', 'ee2598ad-3cc8-402c-b6be-1c372a551bb1'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:56:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:56:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:56:57 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:56:57 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:56:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:56:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:57 devstack sudo[89744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:56:57 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:57 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.413s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:57 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:56:57 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Deleted volume successfully. Apr 25 15:56:57 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-211adafc-badf-4115-8d96-3385e93acb19 tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-a2ca3845-0e97-48d2-91e8-e41620552d30-delete_volume" released by "delete_volume" :: held 6.126s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:56:58 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:56:58 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] Flow 'volume_create_manager' (ac393331-3ce2-4126-ad0f-832032596999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:56:58 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74235f29-e231-464b-b16d-8d7b869c930f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:58 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74235f29-e231-464b-b16d-8d7b869c930f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2127807507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36a1e015-1b6b-4d9f-a7ab-c0faf585c10d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5965b9638f9b4879b25b3b7f58702573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:56:59Z,use_quota=True,user_id='9c0b2907d6c54acdbabe85a7cc54f854',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:58 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d5fcb1f-33b5-4cc0-9be4-1473a0efd4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:58 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d5fcb1f-33b5-4cc0-9be4-1473a0efd4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:58 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a009e214-2616-4f36-99d6-9bb4c70f073d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:58 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a009e214-2616-4f36-99d6-9bb4c70f073d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36a1e015-1b6b-4d9f-a7ab-c0faf585c10d', 'volume_name': 'volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:58 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72d9203f-6c90-46be-8940-037203f0b676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:58 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72d9203f-6c90-46be-8940-037203f0b676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:58 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e03b3e88-d8bc-4fc7-96a3-4645ba0701ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:58 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] Volume 36a1e015-1b6b-4d9f-a7ab-c0faf585c10d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d', 'volume_size': 1} Apr 25 15:56:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:56:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:56:58 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2127807507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36a1e015-1b6b-4d9f-a7ab-c0faf585c10d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5965b9638f9b4879b25b3b7f58702573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:56:59Z,use_quota=True,user_id='9c0b2907d6c54acdbabe85a7cc54f854',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:56:58 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] Creating volume 36a1e015-1b6b-4d9f-a7ab-c0faf585c10d {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:56:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:56:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:56:58 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:56:58 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:56:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:56:58 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:56:58 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:56:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:58 devstack sudo[89747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d 1073741824 Apr 25 15:56:58 devstack sudo[89747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:59 devstack sudo[89747]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d 1073741824" returned: 0 in 0.574s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:56:59 devstack sudo[89752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d Apr 25 15:56:59 devstack sudo[89752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:56:59 devstack sudo[89752]: pam_unix(sudo:session): session closed for user root Apr 25 15:56:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d" returned: 0 in 0.431s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:56:59 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:56:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:56:59 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e03b3e88-d8bc-4fc7-96a3-4645ba0701ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:59 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70231e83-6023-4336-8353-1b30b090f6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:56:59 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] Volume volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d (36a1e015-1b6b-4d9f-a7ab-c0faf585c10d): created successfully Apr 25 15:56:59 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70231e83-6023-4336-8353-1b30b090f6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:56:59 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] Flow 'volume_create_manager' (ac393331-3ce2-4126-ad0f-832032596999) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:56:59 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-b596eed3-2058-43ea-84f9-91b4baa23cdf tempest-VolumesDeleteCascade-746622713 None] Created volume successfully. Apr 25 15:57:00 devstack cinder-volume[81828]: DEBUG oslo_service.periodic_task [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81828) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 25 15:57:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:57:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:57:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:57:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:57:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:57:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:57:00 devstack sudo[89755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:57:00 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:57:00 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root Apr 25 15:57:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.415s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:57:00 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:57:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-5d149d95-4e32-41ab-8ba8-2d1a5d610272 tempest-VolumesDeleteCascade-746622713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:57:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-5d149d95-4e32-41ab-8ba8-2d1a5d610272 tempest-VolumesDeleteCascade-746622713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:57:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-5d149d95-4e32-41ab-8ba8-2d1a5d610272 tempest-VolumesDeleteCascade-746622713 None] Creating offline snapshot e3167f96-7adf-4c9f-89d6-af57dd8895d3 of volume 36a1e015-1b6b-4d9f-a7ab-c0faf585c10d {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 15:57:00 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc2c184-e0a7-4559-b0ee-ae7b13a0618b]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:57:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5d149d95-4e32-41ab-8ba8-2d1a5d610272 tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:57:01 devstack sudo[89758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d Apr 25 15:57:01 devstack sudo[89758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:57:01 devstack sudo[89758]: pam_unix(sudo:session): session closed for user root Apr 25 15:57:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5d149d95-4e32-41ab-8ba8-2d1a5d610272 tempest-VolumesDeleteCascade-746622713 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d" returned: 0 in 0.507s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:57:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5d149d95-4e32-41ab-8ba8-2d1a5d610272 tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d.e3167f96-7adf-4c9f-89d6-af57dd8895d3 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:57:01 devstack sudo[89764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d.e3167f96-7adf-4c9f-89d6-af57dd8895d3 1G Apr 25 15:57:01 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:57:02 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root Apr 25 15:57:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5d149d95-4e32-41ab-8ba8-2d1a5d610272 tempest-VolumesDeleteCascade-746622713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d.e3167f96-7adf-4c9f-89d6-af57dd8895d3 1G" returned: 0 in 0.582s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:57:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5d149d95-4e32-41ab-8ba8-2d1a5d610272 tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d.e3167f96-7adf-4c9f-89d6-af57dd8895d3 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:57:02 devstack sudo[89769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d.e3167f96-7adf-4c9f-89d6-af57dd8895d3 Apr 25 15:57:02 devstack sudo[89769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:57:02 devstack sudo[89769]: pam_unix(sudo:session): session closed for user root Apr 25 15:57:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5d149d95-4e32-41ab-8ba8-2d1a5d610272 tempest-VolumesDeleteCascade-746622713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d.e3167f96-7adf-4c9f-89d6-af57dd8895d3" returned: 0 in 0.459s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:57:02 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-5d149d95-4e32-41ab-8ba8-2d1a5d610272 tempest-VolumesDeleteCascade-746622713 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d.e3167f96-7adf-4c9f-89d6-af57dd8895d3 is being set with open permissions: ugo+rw Apr 25 15:57:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5d149d95-4e32-41ab-8ba8-2d1a5d610272 tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d.e3167f96-7adf-4c9f-89d6-af57dd8895d3 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:57:02 devstack sudo[89774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d.e3167f96-7adf-4c9f-89d6-af57dd8895d3 Apr 25 15:57:02 devstack sudo[89774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:57:02 devstack sudo[89774]: pam_unix(sudo:session): session closed for user root Apr 25 15:57:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5d149d95-4e32-41ab-8ba8-2d1a5d610272 tempest-VolumesDeleteCascade-746622713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d.e3167f96-7adf-4c9f-89d6-af57dd8895d3" returned: 0 in 0.414s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:57:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5d149d95-4e32-41ab-8ba8-2d1a5d610272 tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:57:03 devstack sudo[89777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d.info Apr 25 15:57:03 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:57:03 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root Apr 25 15:57:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5d149d95-4e32-41ab-8ba8-2d1a5d610272 tempest-VolumesDeleteCascade-746622713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d.info" returned: 0 in 0.419s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:57:03 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-5d149d95-4e32-41ab-8ba8-2d1a5d610272 tempest-VolumesDeleteCascade-746622713 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d.info is being set with open permissions: ugo+rw Apr 25 15:57:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5d149d95-4e32-41ab-8ba8-2d1a5d610272 tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:57:03 devstack sudo[89780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d.info Apr 25 15:57:03 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:57:03 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root Apr 25 15:57:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5d149d95-4e32-41ab-8ba8-2d1a5d610272 tempest-VolumesDeleteCascade-746622713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d.info" returned: 0 in 0.404s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:57:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-5d149d95-4e32-41ab-8ba8-2d1a5d610272 tempest-VolumesDeleteCascade-746622713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.870s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:57:03 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-5d149d95-4e32-41ab-8ba8-2d1a5d610272 tempest-VolumesDeleteCascade-746622713 None] Create snapshot completed successfully Apr 25 15:57:03 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:UPDATE=94,cinder:SELECT=77,cinder:DELETE=11,cinder:INSERT=25 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:57:04 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:SELECT=81,cinder:INSERT=24,cinder:UPDATE=95,cinder:DELETE=6 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:57:04 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:57:04 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Flow 'volume_create_manager' (c36dc515-66bb-4405-89e9-af4b6ab538ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:57:04 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a252bb8a-d374-4413-8db4-34886d910433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:57:04 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a252bb8a-d374-4413-8db4-34886d910433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1275741095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f1ca83a-e23f-45b8-8539-9e78d7c549b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5965b9638f9b4879b25b3b7f58702573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e3167f96-7adf-4c9f-89d6-af57dd8895d3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:57:04Z,use_quota=True,user_id='9c0b2907d6c54acdbabe85a7cc54f854',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:57:04 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4c9e5ea-905f-45d1-bdea-8227c5fe0dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:57:04 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4c9e5ea-905f-45d1-bdea-8227c5fe0dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:57:04 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602cf6d9-9629-48c2-b1cc-ef418c440fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:57:04 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602cf6d9-9629-48c2-b1cc-ef418c440fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7f1ca83a-e23f-45b8-8539-9e78d7c549b0', 'volume_name': 'volume-7f1ca83a-e23f-45b8-8539-9e78d7c549b0', 'volume_size': 1, 'snapshot_id': 'e3167f96-7adf-4c9f-89d6-af57dd8895d3'}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:57:04 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fb06bde-15a2-4244-99f6-9140bf4fe02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:57:04 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fb06bde-15a2-4244-99f6-9140bf4fe02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:57:04 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5166b02b-2838-47fc-bb47-fb94f4c0f366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:57:04 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Volume 7f1ca83a-e23f-45b8-8539-9e78d7c549b0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7f1ca83a-e23f-45b8-8539-9e78d7c549b0', 'volume_size': 1, 'snapshot_id': 'e3167f96-7adf-4c9f-89d6-af57dd8895d3'} Apr 25 15:57:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:57:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:57:04 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Acquiring lock "cinder-quobyte-e3167f96-7adf-4c9f-89d6-af57dd8895d3-7f1ca83a-e23f-45b8-8539-9e78d7c549b0" by "_create_volume_from_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:57:04 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-quobyte-e3167f96-7adf-4c9f-89d6-af57dd8895d3-7f1ca83a-e23f-45b8-8539-9e78d7c549b0" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:57:04 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Creating volume 7f1ca83a-e23f-45b8-8539-9e78d7c549b0 from snapshot e3167f96-7adf-4c9f-89d6-af57dd8895d3 {{(pid=81828) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 25 15:57:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:57:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:57:04 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:57:04 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:57:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:57:04 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:57:04 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Acquiring lock "cinder-quobyte-7f1ca83a-e23f-45b8-8539-9e78d7c549b0" by "_copy_volume_from_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:57:04 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-quobyte-7f1ca83a-e23f-45b8-8539-9e78d7c549b0" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:57:04 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] snapshot: e3167f96-7adf-4c9f-89d6-af57dd8895d3, volume: 7f1ca83a-e23f-45b8-8539-9e78d7c549b0, {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 25 15:57:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:57:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:57:04 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:57:04 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:57:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:57:04 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec00cebe-9886-4545-b342-8f2d306ce2e9]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:57:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d.e3167f96-7adf-4c9f-89d6-af57dd8895d3 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:57:04 devstack sudo[89783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d.e3167f96-7adf-4c9f-89d6-af57dd8895d3 Apr 25 15:57:04 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:57:05 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root Apr 25 15:57:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d.e3167f96-7adf-4c9f-89d6-af57dd8895d3" returned: 0 in 0.514s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:57:05 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:57:05 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] will copy from snapshot at /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 25 15:57:05 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Creating direct copy from snapshot {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 25 15:57:05 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac612253-b3c3-4572-a4f7-f0ed388316d4]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:57:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:57:05 devstack sudo[89788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d Apr 25 15:57:05 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:57:05 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root Apr 25 15:57:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d" returned: 0 in 0.534s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:57:05 devstack cinder-volume[81828]: DEBUG cinder.utils [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Path /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7f1ca83a-e23f-45b8-8539-9e78d7c549b0 not found in is_blk_device check {{(pid=81828) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 25 15:57:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7f1ca83a-e23f-45b8-8539-9e78d7c549b0 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:57:05 devstack sudo[89793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7f1ca83a-e23f-45b8-8539-9e78d7c549b0 Apr 25 15:57:05 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:57:09 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root Apr 25 15:57:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7f1ca83a-e23f-45b8-8539-9e78d7c549b0" returned: 0 in 4.225s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:57:09 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa26a335-cfaa-42d4-b4f7-6f65089edeac]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:57:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:57:09 devstack sudo[89805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d Apr 25 15:57:09 devstack sudo[89805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:57:10 devstack sudo[89805]: pam_unix(sudo:session): session closed for user root Apr 25 15:57:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d" returned: 0 in 0.616s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:57:10 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Image conversion details: src /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d, size 1024.00 MB, duration 4.23 sec, destination /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7f1ca83a-e23f-45b8-8539-9e78d7c549b0 {{(pid=81828) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 15:57:10 devstack cinder-volume[81828]: INFO cinder.image.image_utils [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Converted 1024.00 MB image at 242.28 MB/s Apr 25 15:57:10 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7f1ca83a-e23f-45b8-8539-9e78d7c549b0 is being set with open permissions: ugo+rw Apr 25 15:57:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7f1ca83a-e23f-45b8-8539-9e78d7c549b0 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:57:10 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7f1ca83a-e23f-45b8-8539-9e78d7c549b0 Apr 25 15:57:10 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:57:10 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Apr 25 15:57:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7f1ca83a-e23f-45b8-8539-9e78d7c549b0" returned: 0 in 0.427s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:57:10 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-quobyte-7f1ca83a-e23f-45b8-8539-9e78d7c549b0" released by "_copy_volume_from_snapshot" :: held 6.404s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:57:10 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-quobyte-e3167f96-7adf-4c9f-89d6-af57dd8895d3-7f1ca83a-e23f-45b8-8539-9e78d7c549b0" released by "_create_volume_from_snapshot" :: held 6.434s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:57:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.452s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:57:11 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5166b02b-2838-47fc-bb47-fb94f4c0f366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f1ca83a-e23f-45b8-8539-9e78d7c549b0', 'volume_size': 1, 'snapshot_id': 'e3167f96-7adf-4c9f-89d6-af57dd8895d3'}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:57:11 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (655880d9-ea62-4ce9-a358-534e45a482b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:57:11 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Volume volume-7f1ca83a-e23f-45b8-8539-9e78d7c549b0 (7f1ca83a-e23f-45b8-8539-9e78d7c549b0): created successfully Apr 25 15:57:11 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (655880d9-ea62-4ce9-a358-534e45a482b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:57:11 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Flow 'volume_create_manager' (c36dc515-66bb-4405-89e9-af4b6ab538ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:57:11 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-e947e96b-f4f6-43de-9e07-db1262040888 tempest-VolumesDeleteCascade-746622713 None] Created volume successfully. Apr 25 15:57:12 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Acquiring lock "cinder-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:57:12 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:57:12 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Performing cascade delete. {{(pid=81828) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 25 15:57:12 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Acquiring lock "cinder-e3167f96-7adf-4c9f-89d6-af57dd8895d3-delete_snapshot" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:57:12 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-e3167f96-7adf-4c9f-89d6-af57dd8895d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:57:12 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Acquiring lock "cinder-quobyte-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:57:12 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-quobyte-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:57:12 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Acquiring lock "cinder-quobyte-e3167f96-7adf-4c9f-89d6-af57dd8895d3" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:57:12 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-quobyte-e3167f96-7adf-4c9f-89d6-af57dd8895d3" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:57:12 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Deleting offline snapshot e3167f96-7adf-4c9f-89d6-af57dd8895d3 of volume 36a1e015-1b6b-4d9f-a7ab-c0faf585c10d {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 15:57:12 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] snapshot_file for this snap is: volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d.e3167f96-7adf-4c9f-89d6-af57dd8895d3 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 15:57:12 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c3ed6d-1c7a-4c60-9102-7949375e65b1]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:57:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d.e3167f96-7adf-4c9f-89d6-af57dd8895d3 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:57:12 devstack sudo[89847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d.e3167f96-7adf-4c9f-89d6-af57dd8895d3 Apr 25 15:57:12 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:57:12 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root Apr 25 15:57:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d.e3167f96-7adf-4c9f-89d6-af57dd8895d3" returned: 0 in 0.514s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:57:12 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:57:12 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b98fd1-105a-4b53-b187-b265a89cb5c4]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:57:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:57:12 devstack sudo[89854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d Apr 25 15:57:12 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:57:13 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root Apr 25 15:57:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d" returned: 0 in 0.513s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:57:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d.e3167f96-7adf-4c9f-89d6-af57dd8895d3 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:57:13 devstack sudo[89859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d.e3167f96-7adf-4c9f-89d6-af57dd8895d3 Apr 25 15:57:13 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:57:13 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root Apr 25 15:57:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d.e3167f96-7adf-4c9f-89d6-af57dd8895d3" returned: 0 in 0.527s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:57:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d.e3167f96-7adf-4c9f-89d6-af57dd8895d3 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:57:13 devstack sudo[89864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d.e3167f96-7adf-4c9f-89d6-af57dd8895d3 Apr 25 15:57:13 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:57:14 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root Apr 25 15:57:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d.e3167f96-7adf-4c9f-89d6-af57dd8895d3" returned: 0 in 0.444s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:57:14 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-quobyte-e3167f96-7adf-4c9f-89d6-af57dd8895d3" released by "_delete_snapshot" :: held 2.084s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:57:14 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-quobyte-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d" released by "delete_snapshot" :: held 2.103s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:57:14 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Created reservations ['1b6504bb-b925-4fd4-8b9f-cab7db56b611', 'de0e1489-5d4d-4758-b7f8-77c457417469', '77f11bc8-ba7e-47e7-9784-dfa35b0b8bc3', '3f6d1513-dbeb-458d-a674-063c88288ea9'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:57:14 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Delete snapshot completed successfully. Apr 25 15:57:14 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-e3167f96-7adf-4c9f-89d6-af57dd8895d3-delete_snapshot" released by "delete_snapshot" :: held 2.235s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:57:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Snapshots deleted, issuing volume delete {{(pid=81828) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 25 15:57:14 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Acquiring lock "cinder-quobyte-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:57:14 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-quobyte-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d" acquired by "delete_volume" :: waited 0.013s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:57:14 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29107cf-f0a9-4146-933b-8f163a619e0f]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:57:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:57:14 devstack sudo[89867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d Apr 25 15:57:14 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:57:14 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root Apr 25 15:57:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d" returned: 0 in 0.490s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:57:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:57:14 devstack sudo[89872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d Apr 25 15:57:14 devstack sudo[89872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:57:15 devstack sudo[89872]: pam_unix(sudo:session): session closed for user root Apr 25 15:57:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d" returned: 0 in 0.435s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:57:15 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-quobyte-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d" released by "delete_volume" :: held 0.980s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:57:15 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Created reservations ['46de06d4-3776-4634-963a-fedc6a4386b7', '00c1e3a8-834b-46ac-96b7-5c88bc286328', '0657ea9c-9f25-4196-8d25-5f39aa9c29d5', '7a670fce-3b99-4c26-ba05-2b7c564a19dc'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:57:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:57:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:57:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:57:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:57:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:57:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:57:15 devstack sudo[89875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:57:15 devstack sudo[89875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:57:15 devstack sudo[89875]: pam_unix(sudo:session): session closed for user root Apr 25 15:57:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.423s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:57:15 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:57:15 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Deleted volume successfully. Apr 25 15:57:15 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ed89fb16-8dba-43c3-99b6-285e3d937ecc tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-36a1e015-1b6b-4d9f-a7ab-c0faf585c10d-delete_volume" released by "delete_volume" :: held 3.859s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:57:16 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-cff856bd-d7ed-42e3-bc66-d0fcf6da6ab7 tempest-VolumesDeleteCascade-746622713 None] Acquiring lock "cinder-7f1ca83a-e23f-45b8-8539-9e78d7c549b0-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:57:16 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-cff856bd-d7ed-42e3-bc66-d0fcf6da6ab7 tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-7f1ca83a-e23f-45b8-8539-9e78d7c549b0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:57:16 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-cff856bd-d7ed-42e3-bc66-d0fcf6da6ab7 tempest-VolumesDeleteCascade-746622713 None] Acquiring lock "cinder-quobyte-7f1ca83a-e23f-45b8-8539-9e78d7c549b0" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:57:16 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-cff856bd-d7ed-42e3-bc66-d0fcf6da6ab7 tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-quobyte-7f1ca83a-e23f-45b8-8539-9e78d7c549b0" acquired by "delete_volume" :: waited 0.015s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:57:16 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdac8f4a-9901-468f-b1a7-396e1501dc6a]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:57:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-cff856bd-d7ed-42e3-bc66-d0fcf6da6ab7 tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7f1ca83a-e23f-45b8-8539-9e78d7c549b0 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:57:16 devstack sudo[89878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7f1ca83a-e23f-45b8-8539-9e78d7c549b0 Apr 25 15:57:16 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:57:17 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root Apr 25 15:57:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-cff856bd-d7ed-42e3-bc66-d0fcf6da6ab7 tempest-VolumesDeleteCascade-746622713 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7f1ca83a-e23f-45b8-8539-9e78d7c549b0" returned: 0 in 0.511s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:57:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-cff856bd-d7ed-42e3-bc66-d0fcf6da6ab7 tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7f1ca83a-e23f-45b8-8539-9e78d7c549b0 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:57:17 devstack sudo[89883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7f1ca83a-e23f-45b8-8539-9e78d7c549b0 Apr 25 15:57:17 devstack sudo[89883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:57:17 devstack sudo[89883]: pam_unix(sudo:session): session closed for user root Apr 25 15:57:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-cff856bd-d7ed-42e3-bc66-d0fcf6da6ab7 tempest-VolumesDeleteCascade-746622713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7f1ca83a-e23f-45b8-8539-9e78d7c549b0" returned: 0 in 0.419s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:57:17 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-cff856bd-d7ed-42e3-bc66-d0fcf6da6ab7 tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-quobyte-7f1ca83a-e23f-45b8-8539-9e78d7c549b0" released by "delete_volume" :: held 0.975s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:57:17 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-cff856bd-d7ed-42e3-bc66-d0fcf6da6ab7 tempest-VolumesDeleteCascade-746622713 None] Created reservations ['93737ce8-842d-4941-a92d-bb215593bc4d', 'a7c7e997-1254-41d5-a248-8b1e75f73c6b', 'd1c3383c-113f-4247-95fa-7f19a41ba915', '700cec8c-882b-4200-9cae-ef0afaf9c82f'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:57:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-cff856bd-d7ed-42e3-bc66-d0fcf6da6ab7 tempest-VolumesDeleteCascade-746622713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:57:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-cff856bd-d7ed-42e3-bc66-d0fcf6da6ab7 tempest-VolumesDeleteCascade-746622713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:57:17 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-cff856bd-d7ed-42e3-bc66-d0fcf6da6ab7 tempest-VolumesDeleteCascade-746622713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:57:17 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-cff856bd-d7ed-42e3-bc66-d0fcf6da6ab7 tempest-VolumesDeleteCascade-746622713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:57:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-cff856bd-d7ed-42e3-bc66-d0fcf6da6ab7 tempest-VolumesDeleteCascade-746622713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:57:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-cff856bd-d7ed-42e3-bc66-d0fcf6da6ab7 tempest-VolumesDeleteCascade-746622713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:57:17 devstack sudo[89886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:57:17 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:57:18 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root Apr 25 15:57:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-cff856bd-d7ed-42e3-bc66-d0fcf6da6ab7 tempest-VolumesDeleteCascade-746622713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.436s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:57:18 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-cff856bd-d7ed-42e3-bc66-d0fcf6da6ab7 tempest-VolumesDeleteCascade-746622713 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:57:18 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-cff856bd-d7ed-42e3-bc66-d0fcf6da6ab7 tempest-VolumesDeleteCascade-746622713 None] Deleted volume successfully. Apr 25 15:57:18 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-cff856bd-d7ed-42e3-bc66-d0fcf6da6ab7 tempest-VolumesDeleteCascade-746622713 None] Lock "cinder-7f1ca83a-e23f-45b8-8539-9e78d7c549b0-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:57:27 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:SELECT=19,cinder:UPDATE=19,cinder:DELETE=1,cinder:INSERT=9 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:57:28 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:SELECT=17,cinder:UPDATE=27,cinder:INSERT=3,cinder:DELETE=2 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:57:29 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:57:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] Flow 'volume_create_manager' (25dc7fd3-fda8-4711-8138-6b4b364e0854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:57:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e975384d-0c29-4891-945e-3707bc4f25a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:57:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e975384d-0c29-4891-945e-3707bc4f25a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1361951299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=916d26f5-cab3-4ebf-8bd5-ddb237710904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0de49b509e4e5eb2a6750f47c6d040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:57:29Z,use_quota=True,user_id='7c08008f2e3641a7910dec800214b6b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:57:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a21d441a-b315-46e8-80d3-7b0f31f0cf80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:57:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a21d441a-b315-46e8-80d3-7b0f31f0cf80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:57:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8479daff-69ad-4909-a131-74fc33982ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:57:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8479daff-69ad-4909-a131-74fc33982ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '916d26f5-cab3-4ebf-8bd5-ddb237710904', 'volume_name': 'volume-916d26f5-cab3-4ebf-8bd5-ddb237710904', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:57:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c419f06-b831-4a18-a496-a440791f8c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:57:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c419f06-b831-4a18-a496-a440791f8c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:57:29 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3782940f-1ce6-4c1d-8b67-0e30b36c9157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:57:29 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] Volume 916d26f5-cab3-4ebf-8bd5-ddb237710904: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-916d26f5-cab3-4ebf-8bd5-ddb237710904', 'volume_size': 1} Apr 25 15:57:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:57:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:57:29 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1361951299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=916d26f5-cab3-4ebf-8bd5-ddb237710904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db0de49b509e4e5eb2a6750f47c6d040',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:57:29Z,use_quota=True,user_id='7c08008f2e3641a7910dec800214b6b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:57:29 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] Creating volume 916d26f5-cab3-4ebf-8bd5-ddb237710904 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:57:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:57:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:57:29 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:57:29 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:57:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:57:29 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:57:29 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:57:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:57:29 devstack sudo[89891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904 1073741824 Apr 25 15:57:29 devstack sudo[89891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:57:29 devstack sudo[89891]: pam_unix(sudo:session): session closed for user root Apr 25 15:57:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904 1073741824" returned: 0 in 0.589s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:57:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:57:30 devstack sudo[89896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904 Apr 25 15:57:30 devstack sudo[89896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:57:30 devstack sudo[89896]: pam_unix(sudo:session): session closed for user root Apr 25 15:57:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904" returned: 0 in 0.421s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:57:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:57:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:57:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3782940f-1ce6-4c1d-8b67-0e30b36c9157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-916d26f5-cab3-4ebf-8bd5-ddb237710904', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:57:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e935939a-0fb9-433f-aa7e-bf817f437c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:57:30 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] Volume volume-916d26f5-cab3-4ebf-8bd5-ddb237710904 (916d26f5-cab3-4ebf-8bd5-ddb237710904): created successfully Apr 25 15:57:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e935939a-0fb9-433f-aa7e-bf817f437c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:57:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] Flow 'volume_create_manager' (25dc7fd3-fda8-4711-8138-6b4b364e0854) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:57:30 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-f531fc44-598b-4126-b590-f225e8437cc3 tempest-VolumesActionsTest-2036297747 None] Created volume successfully. Apr 25 15:57:40 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:57:40 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:57:49 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d6e2e233-0400-4744-8099-893e134301cf tempest-VolumesActionsTest-2036297747 None] Acquiring lock "cinder-916d26f5-cab3-4ebf-8bd5-ddb237710904" by "attach_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:57:49 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d6e2e233-0400-4744-8099-893e134301cf tempest-VolumesActionsTest-2036297747 None] Lock "cinder-916d26f5-cab3-4ebf-8bd5-ddb237710904" acquired by "attach_volume" :: waited 0.018s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:57:49 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-d6e2e233-0400-4744-8099-893e134301cf tempest-VolumesActionsTest-2036297747 None] Attaching volume 916d26f5-cab3-4ebf-8bd5-ddb237710904 to instance 3eb1dc23-3883-457a-952c-240446dd9a0e at mountpoint /dev/vdb on host None. Apr 25 15:57:49 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-d6e2e233-0400-4744-8099-893e134301cf tempest-VolumesActionsTest-2036297747 None] Attach volume completed successfully. Apr 25 15:57:49 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d6e2e233-0400-4744-8099-893e134301cf tempest-VolumesActionsTest-2036297747 None] Lock "cinder-916d26f5-cab3-4ebf-8bd5-ddb237710904" released by "attach_volume" :: held 0.085s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:57:49 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a7e8e44e-17ee-47e9-b6da-c0d807b9638d tempest-VolumesActionsTest-2036297747 None] Acquiring lock "cinder-916d26f5-cab3-4ebf-8bd5-ddb237710904-detach_volume" by "detach_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:57:49 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a7e8e44e-17ee-47e9-b6da-c0d807b9638d tempest-VolumesActionsTest-2036297747 None] Lock "cinder-916d26f5-cab3-4ebf-8bd5-ddb237710904-detach_volume" acquired by "detach_volume" :: waited 0.013s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:57:49 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-a7e8e44e-17ee-47e9-b6da-c0d807b9638d tempest-VolumesActionsTest-2036297747 None] Detaching volume 916d26f5-cab3-4ebf-8bd5-ddb237710904 from instance 3eb1dc23-3883-457a-952c-240446dd9a0e. Apr 25 15:57:49 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-a7e8e44e-17ee-47e9-b6da-c0d807b9638d tempest-VolumesActionsTest-2036297747 None] Detach volume completed successfully. Apr 25 15:57:49 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a7e8e44e-17ee-47e9-b6da-c0d807b9638d tempest-VolumesActionsTest-2036297747 None] Lock "cinder-916d26f5-cab3-4ebf-8bd5-ddb237710904-detach_volume" released by "detach_volume" :: held 0.047s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:57:59 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:INSERT=2,cinder:SELECT=3,cinder:UPDATE=3 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:57:59 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:SELECT=10,cinder:UPDATE=3 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:58:00 devstack cinder-volume[81828]: DEBUG oslo_service.periodic_task [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81828) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 25 15:58:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:58:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:58:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:58:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:58:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:58:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:58:00 devstack sudo[90016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:58:00 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:58:00 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root Apr 25 15:58:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.426s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:58:00 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:58:13 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b9aeba6c-56f4-46e1-a1a6-85bd06a99518 tempest-VolumesActionsTest-2036297747 None] Acquiring lock "cinder-916d26f5-cab3-4ebf-8bd5-ddb237710904" by "attach_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:58:13 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b9aeba6c-56f4-46e1-a1a6-85bd06a99518 tempest-VolumesActionsTest-2036297747 None] Lock "cinder-916d26f5-cab3-4ebf-8bd5-ddb237710904" acquired by "attach_volume" :: waited 0.050s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:58:13 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-b9aeba6c-56f4-46e1-a1a6-85bd06a99518 tempest-VolumesActionsTest-2036297747 None] Attaching volume 916d26f5-cab3-4ebf-8bd5-ddb237710904 to instance 8c3ab631-3831-433f-a584-2c681f0c6732 at mountpoint /dev/vdb on host None. Apr 25 15:58:13 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-b9aeba6c-56f4-46e1-a1a6-85bd06a99518 tempest-VolumesActionsTest-2036297747 None] Attach volume completed successfully. Apr 25 15:58:13 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b9aeba6c-56f4-46e1-a1a6-85bd06a99518 tempest-VolumesActionsTest-2036297747 None] Lock "cinder-916d26f5-cab3-4ebf-8bd5-ddb237710904" released by "attach_volume" :: held 0.080s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:58:14 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-dbdab775-ff61-4619-9335-9d5710e7975a tempest-VolumesActionsTest-2036297747 None] Acquiring lock "cinder-916d26f5-cab3-4ebf-8bd5-ddb237710904-detach_volume" by "detach_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:58:14 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-dbdab775-ff61-4619-9335-9d5710e7975a tempest-VolumesActionsTest-2036297747 None] Lock "cinder-916d26f5-cab3-4ebf-8bd5-ddb237710904-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:58:14 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-dbdab775-ff61-4619-9335-9d5710e7975a tempest-VolumesActionsTest-2036297747 None] Detaching volume 916d26f5-cab3-4ebf-8bd5-ddb237710904 from instance 8c3ab631-3831-433f-a584-2c681f0c6732. Apr 25 15:58:14 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-dbdab775-ff61-4619-9335-9d5710e7975a tempest-VolumesActionsTest-2036297747 None] Detach volume completed successfully. Apr 25 15:58:14 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-dbdab775-ff61-4619-9335-9d5710e7975a tempest-VolumesActionsTest-2036297747 None] Lock "cinder-916d26f5-cab3-4ebf-8bd5-ddb237710904-detach_volume" released by "detach_volume" :: held 0.056s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:58:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b6bd1eda-0631-4892-b02b-792284a096d7 tempest-VolumesActionsTest-2036297747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:58:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b6bd1eda-0631-4892-b02b-792284a096d7 tempest-VolumesActionsTest-2036297747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:58:23 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d46ae20-5d78-4b61-8d4d-6c6a7a25674b]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:58:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b6bd1eda-0631-4892-b02b-792284a096d7 tempest-VolumesActionsTest-2036297747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:58:23 devstack sudo[90170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904 Apr 25 15:58:23 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:58:24 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root Apr 25 15:58:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b6bd1eda-0631-4892-b02b-792284a096d7 tempest-VolumesActionsTest-2036297747 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904" returned: 0 in 0.512s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:58:24 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[1195e9d1-3df2-4556-a125-16d62f35cfe3]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:58:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b6bd1eda-0631-4892-b02b-792284a096d7 tempest-VolumesActionsTest-2036297747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:58:24 devstack sudo[90175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904 Apr 25 15:58:24 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:58:24 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root Apr 25 15:58:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b6bd1eda-0631-4892-b02b-792284a096d7 tempest-VolumesActionsTest-2036297747 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904" returned: 0 in 0.526s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:58:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b6bd1eda-0631-4892-b02b-792284a096d7 tempest-VolumesActionsTest-2036297747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904 /opt/stack/data/cinder/conversion/916d26f5-cab3-4ebf-8bd5-ddb237710904.temp_image.054863b3-214b-49d3-b1e7-7b9b82b8f328b_fv1w88.img {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:58:24 devstack sudo[90180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904 /opt/stack/data/cinder/conversion/916d26f5-cab3-4ebf-8bd5-ddb237710904.temp_image.054863b3-214b-49d3-b1e7-7b9b82b8f328b_fv1w88.img Apr 25 15:58:24 devstack sudo[90180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:58:29 devstack sudo[90180]: pam_unix(sudo:session): session closed for user root Apr 25 15:58:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b6bd1eda-0631-4892-b02b-792284a096d7 tempest-VolumesActionsTest-2036297747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904 /opt/stack/data/cinder/conversion/916d26f5-cab3-4ebf-8bd5-ddb237710904.temp_image.054863b3-214b-49d3-b1e7-7b9b82b8f328b_fv1w88.img" returned: 0 in 4.146s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:58:29 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[84737f01-7436-4cba-adfd-856f1bbc9c86]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:58:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b6bd1eda-0631-4892-b02b-792284a096d7 tempest-VolumesActionsTest-2036297747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:58:29 devstack sudo[90192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904 Apr 25 15:58:29 devstack sudo[90192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:58:29 devstack sudo[90192]: pam_unix(sudo:session): session closed for user root Apr 25 15:58:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b6bd1eda-0631-4892-b02b-792284a096d7 tempest-VolumesActionsTest-2036297747 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904" returned: 0 in 0.628s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:58:29 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-b6bd1eda-0631-4892-b02b-792284a096d7 tempest-VolumesActionsTest-2036297747 None] Image conversion details: src /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904, size 1024.00 MB, duration 4.15 sec, destination /opt/stack/data/cinder/conversion/916d26f5-cab3-4ebf-8bd5-ddb237710904.temp_image.054863b3-214b-49d3-b1e7-7b9b82b8f328b_fv1w88.img {{(pid=81828) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 15:58:29 devstack cinder-volume[81828]: INFO cinder.image.image_utils [None req-b6bd1eda-0631-4892-b02b-792284a096d7 tempest-VolumesActionsTest-2036297747 None] Converted 1024.00 MB image at 246.87 MB/s Apr 25 15:58:29 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-b6bd1eda-0631-4892-b02b-792284a096d7 tempest-VolumesActionsTest-2036297747 None] 054863b3-214b-49d3-b1e7-7b9b82b8f328 was raw, no need to convert to raw {{(pid=81828) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 25 15:58:39 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:SELECT=12,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:58:39 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:INSERT=1,cinder:SELECT=5,cinder:UPDATE=2 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:58:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b6bd1eda-0631-4892-b02b-792284a096d7 tempest-VolumesActionsTest-2036297747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 20.889s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:58:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b6bd1eda-0631-4892-b02b-792284a096d7 tempest-VolumesActionsTest-2036297747 None] Uploaded volume to glance image-id: 054863b3-214b-49d3-b1e7-7b9b82b8f328. {{(pid=81828) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 25 15:58:44 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-b6bd1eda-0631-4892-b02b-792284a096d7 tempest-VolumesActionsTest-2036297747 None] Copy volume to image completed successfully. Apr 25 15:58:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3a2ab351-78d5-48f9-a20c-b4ebe5e840c9 tempest-VolumesActionsTest-2036297747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:58:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3a2ab351-78d5-48f9-a20c-b4ebe5e840c9 tempest-VolumesActionsTest-2036297747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:58:46 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5b8af0-334f-461e-ba5a-d970db8fe8b4]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:58:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2ab351-78d5-48f9-a20c-b4ebe5e840c9 tempest-VolumesActionsTest-2036297747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:58:46 devstack sudo[90206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904 Apr 25 15:58:46 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:58:47 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root Apr 25 15:58:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2ab351-78d5-48f9-a20c-b4ebe5e840c9 tempest-VolumesActionsTest-2036297747 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904" returned: 0 in 0.502s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:58:47 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[19408d7d-06c1-4ed5-afe2-ce4484aa3fe4]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:58:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2ab351-78d5-48f9-a20c-b4ebe5e840c9 tempest-VolumesActionsTest-2036297747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:58:47 devstack sudo[90211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904 Apr 25 15:58:47 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:58:47 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root Apr 25 15:58:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2ab351-78d5-48f9-a20c-b4ebe5e840c9 tempest-VolumesActionsTest-2036297747 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904" returned: 0 in 0.507s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:58:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2ab351-78d5-48f9-a20c-b4ebe5e840c9 tempest-VolumesActionsTest-2036297747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904 /opt/stack/data/cinder/conversion/916d26f5-cab3-4ebf-8bd5-ddb237710904.temp_image.ac0047c5-2ecf-492d-a958-bf0e1211ee58ystfzpvi.img {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:58:47 devstack sudo[90216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904 /opt/stack/data/cinder/conversion/916d26f5-cab3-4ebf-8bd5-ddb237710904.temp_image.ac0047c5-2ecf-492d-a958-bf0e1211ee58ystfzpvi.img Apr 25 15:58:47 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:58:52 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root Apr 25 15:58:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2ab351-78d5-48f9-a20c-b4ebe5e840c9 tempest-VolumesActionsTest-2036297747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904 /opt/stack/data/cinder/conversion/916d26f5-cab3-4ebf-8bd5-ddb237710904.temp_image.ac0047c5-2ecf-492d-a958-bf0e1211ee58ystfzpvi.img" returned: 0 in 4.264s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:58:52 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e9ced9-7319-4d1b-b24a-72b789485e97]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:58:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2ab351-78d5-48f9-a20c-b4ebe5e840c9 tempest-VolumesActionsTest-2036297747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:58:52 devstack sudo[90235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904 Apr 25 15:58:52 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:58:52 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root Apr 25 15:58:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2ab351-78d5-48f9-a20c-b4ebe5e840c9 tempest-VolumesActionsTest-2036297747 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904" returned: 0 in 0.615s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:58:52 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-3a2ab351-78d5-48f9-a20c-b4ebe5e840c9 tempest-VolumesActionsTest-2036297747 None] Image conversion details: src /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904, size 1024.00 MB, duration 4.27 sec, destination /opt/stack/data/cinder/conversion/916d26f5-cab3-4ebf-8bd5-ddb237710904.temp_image.ac0047c5-2ecf-492d-a958-bf0e1211ee58ystfzpvi.img {{(pid=81828) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 15:58:52 devstack cinder-volume[81828]: INFO cinder.image.image_utils [None req-3a2ab351-78d5-48f9-a20c-b4ebe5e840c9 tempest-VolumesActionsTest-2036297747 None] Converted 1024.00 MB image at 240.08 MB/s Apr 25 15:58:52 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-3a2ab351-78d5-48f9-a20c-b4ebe5e840c9 tempest-VolumesActionsTest-2036297747 None] ac0047c5-2ecf-492d-a958-bf0e1211ee58 was raw, converting to qcow2 {{(pid=81828) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 25 15:58:52 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6fe950-70ad-42c6-9036-2e373856659d]: (4, 'raw') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:58:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2ab351-78d5-48f9-a20c-b4ebe5e840c9 tempest-VolumesActionsTest-2036297747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/916d26f5-cab3-4ebf-8bd5-ddb237710904.temp_image.ac0047c5-2ecf-492d-a958-bf0e1211ee58ystfzpvi.img {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:58:52 devstack sudo[90240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/916d26f5-cab3-4ebf-8bd5-ddb237710904.temp_image.ac0047c5-2ecf-492d-a958-bf0e1211ee58ystfzpvi.img Apr 25 15:58:52 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:58:53 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root Apr 25 15:58:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2ab351-78d5-48f9-a20c-b4ebe5e840c9 tempest-VolumesActionsTest-2036297747 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/916d26f5-cab3-4ebf-8bd5-ddb237710904.temp_image.ac0047c5-2ecf-492d-a958-bf0e1211ee58ystfzpvi.img" returned: 0 in 0.465s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:58:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2ab351-78d5-48f9-a20c-b4ebe5e840c9 tempest-VolumesActionsTest-2036297747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/916d26f5-cab3-4ebf-8bd5-ddb237710904.temp_image.ac0047c5-2ecf-492d-a958-bf0e1211ee58ystfzpvi.img {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:58:53 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/916d26f5-cab3-4ebf-8bd5-ddb237710904.temp_image.ac0047c5-2ecf-492d-a958-bf0e1211ee58ystfzpvi.img Apr 25 15:58:53 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:58:53 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Apr 25 15:58:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2ab351-78d5-48f9-a20c-b4ebe5e840c9 tempest-VolumesActionsTest-2036297747 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/916d26f5-cab3-4ebf-8bd5-ddb237710904.temp_image.ac0047c5-2ecf-492d-a958-bf0e1211ee58ystfzpvi.img" returned: 1 in 0.461s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:58:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2ab351-78d5-48f9-a20c-b4ebe5e840c9 tempest-VolumesActionsTest-2036297747 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/916d26f5-cab3-4ebf-8bd5-ddb237710904.temp_image.ac0047c5-2ecf-492d-a958-bf0e1211ee58ystfzpvi.img' failed. Not Retrying. {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 25 15:58:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2ab351-78d5-48f9-a20c-b4ebe5e840c9 tempest-VolumesActionsTest-2036297747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/916d26f5-cab3-4ebf-8bd5-ddb237710904.temp_image.ac0047c5-2ecf-492d-a958-bf0e1211ee58ystfzpvi.img /opt/stack/data/cinder/conversion/vol_upload_5kdfgmih {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:58:53 devstack sudo[90249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/916d26f5-cab3-4ebf-8bd5-ddb237710904.temp_image.ac0047c5-2ecf-492d-a958-bf0e1211ee58ystfzpvi.img /opt/stack/data/cinder/conversion/vol_upload_5kdfgmih Apr 25 15:58:53 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:58:54 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root Apr 25 15:58:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2ab351-78d5-48f9-a20c-b4ebe5e840c9 tempest-VolumesActionsTest-2036297747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/916d26f5-cab3-4ebf-8bd5-ddb237710904.temp_image.ac0047c5-2ecf-492d-a958-bf0e1211ee58ystfzpvi.img /opt/stack/data/cinder/conversion/vol_upload_5kdfgmih" returned: 0 in 0.424s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:58:54 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-3a2ab351-78d5-48f9-a20c-b4ebe5e840c9 tempest-VolumesActionsTest-2036297747 None] Image conversion details: src /opt/stack/data/cinder/conversion/916d26f5-cab3-4ebf-8bd5-ddb237710904.temp_image.ac0047c5-2ecf-492d-a958-bf0e1211ee58ystfzpvi.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_5kdfgmih {{(pid=81828) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 15:58:54 devstack cinder-volume[81828]: INFO cinder.image.image_utils [None req-3a2ab351-78d5-48f9-a20c-b4ebe5e840c9 tempest-VolumesActionsTest-2036297747 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 25 15:58:54 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[6621b1e4-6447-4713-8d70-58918ad5c4be]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:58:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2ab351-78d5-48f9-a20c-b4ebe5e840c9 tempest-VolumesActionsTest-2036297747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5kdfgmih {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:58:54 devstack sudo[90254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5kdfgmih Apr 25 15:58:54 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:58:54 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root Apr 25 15:58:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3a2ab351-78d5-48f9-a20c-b4ebe5e840c9 tempest-VolumesActionsTest-2036297747 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_5kdfgmih" returned: 0 in 0.459s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:58:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3a2ab351-78d5-48f9-a20c-b4ebe5e840c9 tempest-VolumesActionsTest-2036297747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.860s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:58:55 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3a2ab351-78d5-48f9-a20c-b4ebe5e840c9 tempest-VolumesActionsTest-2036297747 None] Uploaded volume to glance image-id: ac0047c5-2ecf-492d-a958-bf0e1211ee58. {{(pid=81828) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 25 15:58:55 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-3a2ab351-78d5-48f9-a20c-b4ebe5e840c9 tempest-VolumesActionsTest-2036297747 None] Copy volume to image completed successfully. Apr 25 15:58:56 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-02cad96a-d593-49ad-b3e5-5fb7013c6d2e tempest-VolumesActionsTest-2036297747 None] Acquiring lock "cinder-916d26f5-cab3-4ebf-8bd5-ddb237710904-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:58:56 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-02cad96a-d593-49ad-b3e5-5fb7013c6d2e tempest-VolumesActionsTest-2036297747 None] Lock "cinder-916d26f5-cab3-4ebf-8bd5-ddb237710904-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:58:56 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-02cad96a-d593-49ad-b3e5-5fb7013c6d2e tempest-VolumesActionsTest-2036297747 None] Acquiring lock "cinder-quobyte-916d26f5-cab3-4ebf-8bd5-ddb237710904" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:58:56 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-02cad96a-d593-49ad-b3e5-5fb7013c6d2e tempest-VolumesActionsTest-2036297747 None] Lock "cinder-quobyte-916d26f5-cab3-4ebf-8bd5-ddb237710904" acquired by "delete_volume" :: waited 0.019s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:58:56 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6519985-98c8-44a3-ba73-b69d886c1c98]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:58:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-02cad96a-d593-49ad-b3e5-5fb7013c6d2e tempest-VolumesActionsTest-2036297747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:58:56 devstack sudo[90259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904 Apr 25 15:58:56 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:58:57 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root Apr 25 15:58:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-02cad96a-d593-49ad-b3e5-5fb7013c6d2e tempest-VolumesActionsTest-2036297747 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904" returned: 0 in 0.521s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:58:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-02cad96a-d593-49ad-b3e5-5fb7013c6d2e tempest-VolumesActionsTest-2036297747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:58:57 devstack sudo[90264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904 Apr 25 15:58:57 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:58:57 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root Apr 25 15:58:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-02cad96a-d593-49ad-b3e5-5fb7013c6d2e tempest-VolumesActionsTest-2036297747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-916d26f5-cab3-4ebf-8bd5-ddb237710904" returned: 0 in 0.430s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:58:57 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-02cad96a-d593-49ad-b3e5-5fb7013c6d2e tempest-VolumesActionsTest-2036297747 None] Lock "cinder-quobyte-916d26f5-cab3-4ebf-8bd5-ddb237710904" released by "delete_volume" :: held 0.991s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:58:57 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-02cad96a-d593-49ad-b3e5-5fb7013c6d2e tempest-VolumesActionsTest-2036297747 None] Created reservations ['71ea93a4-5942-411e-b140-f9c3d2efa0bd', '7a1af9e7-7310-41e9-8b96-3885ca7a6e9f', '3031a754-3dbb-41ef-8d3a-cc3c7123ff6a', '1f448023-f077-47df-931a-d320c26ee24a'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:58:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-02cad96a-d593-49ad-b3e5-5fb7013c6d2e tempest-VolumesActionsTest-2036297747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:58:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-02cad96a-d593-49ad-b3e5-5fb7013c6d2e tempest-VolumesActionsTest-2036297747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:58:57 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-02cad96a-d593-49ad-b3e5-5fb7013c6d2e tempest-VolumesActionsTest-2036297747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:58:57 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-02cad96a-d593-49ad-b3e5-5fb7013c6d2e tempest-VolumesActionsTest-2036297747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:58:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-02cad96a-d593-49ad-b3e5-5fb7013c6d2e tempest-VolumesActionsTest-2036297747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:58:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-02cad96a-d593-49ad-b3e5-5fb7013c6d2e tempest-VolumesActionsTest-2036297747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:58:57 devstack sudo[90267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:58:57 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:58:58 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root Apr 25 15:58:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-02cad96a-d593-49ad-b3e5-5fb7013c6d2e tempest-VolumesActionsTest-2036297747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.408s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:58:58 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-02cad96a-d593-49ad-b3e5-5fb7013c6d2e tempest-VolumesActionsTest-2036297747 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:58:58 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-02cad96a-d593-49ad-b3e5-5fb7013c6d2e tempest-VolumesActionsTest-2036297747 None] Deleted volume successfully. Apr 25 15:58:58 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-02cad96a-d593-49ad-b3e5-5fb7013c6d2e tempest-VolumesActionsTest-2036297747 None] Lock "cinder-916d26f5-cab3-4ebf-8bd5-ddb237710904-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:59:00 devstack cinder-volume[81828]: DEBUG oslo_service.periodic_task [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81828) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 25 15:59:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:59:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:59:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:59:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:59:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:59:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:00 devstack sudo[90272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:59:00 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:00 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.475s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:00 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:59:03 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:59:03 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Flow 'volume_create_manager' (5105e7ac-24c6-44de-b965-ca44058dedf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:59:03 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d823ed6a-9b5f-4df1-bbbb-d77c25756e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:03 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d823ed6a-9b5f-4df1-bbbb-d77c25756e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1999342105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e83f840-0aef-4091-a1b9-45be195a0000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c497b54eb01c46a281aa2be24721e5b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:59:04Z,use_quota=True,user_id='9d1c5537d4e6468fa36f9c8cd76df8ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:03 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a4c52d-3d26-4940-a293-2474347786cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:03 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33a4c52d-3d26-4940-a293-2474347786cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:03 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb73637-76ea-4a35-8757-9268585a12a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:03 devstack cinder-volume[81828]: DEBUG cinder.image.glance [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Creating Keystone auth plugin from conf {{(pid=81828) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 25 15:59:04 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecb73637-76ea-4a35-8757-9268585a12a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6e83f840-0aef-4091-a1b9-45be195a0000', 'volume_name': 'volume-6e83f840-0aef-4091-a1b9-45be195a0000', 'volume_size': 1, 'image_id': '4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99560f74c63f4b9285294e59133188d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'created_at': datetime.datetime(2026, 4, 25, 13, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 13, 42, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:04 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b3e1945-7c6d-431f-bfe8-1244a2ff4dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:04 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b3e1945-7c6d-431f-bfe8-1244a2ff4dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:04 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaafcb75-fe7d-4603-8534-c10d82c5e5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:04 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Volume 6e83f840-0aef-4091-a1b9-45be195a0000: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6e83f840-0aef-4091-a1b9-45be195a0000', 'volume_size': 1, 'image_id': '4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99560f74c63f4b9285294e59133188d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'created_at': datetime.datetime(2026, 4, 25, 13, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 13, 42, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 25 15:59:04 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Trying to clone 6e83f840-0aef-4091-a1b9-45be195a0000 from image 4a29fc86-7ce4-447e-98ea-c141a6c39b3d at location (None, [{'url': 'file:///opt/stack/data/glance/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'metadata': {}}]). {{(pid=81828) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 25 15:59:04 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_ymnb8smudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=81828) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 25 15:59:04 devstack cinder-volume[81828]: INFO cinder.image.image_utils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Image download 20.69 MB at 20.69 MB/s Apr 25 15:59:04 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c75c9da-00e5-4892-937a-07bc069369dc]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:59:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_ymnb8smudevstack@QuobyteHD {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:04 devstack sudo[90278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_ymnb8smudevstack@QuobyteHD Apr 25 15:59:04 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:04 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_ymnb8smudevstack@QuobyteHD" returned: 0 in 0.480s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:04 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Temporary image 4a29fc86-7ce4-447e-98ea-c141a6c39b3d is fetched for user 9d1c5537d4e6468fa36f9c8cd76df8ab. {{(pid=81828) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 25 15:59:04 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b820a79-18a4-44c1-a56e-3f03c5e165a7]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:59:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_ymnb8smudevstack@QuobyteHD {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:04 devstack sudo[90283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_ymnb8smudevstack@QuobyteHD Apr 25 15:59:04 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:05 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_ymnb8smudevstack@QuobyteHD" returned: 0 in 0.492s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:59:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:59:05 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:59:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1999342105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e83f840-0aef-4091-a1b9-45be195a0000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c497b54eb01c46a281aa2be24721e5b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:59:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:59:04Z,use_quota=True,user_id='9d1c5537d4e6468fa36f9c8cd76df8ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:59:05 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Creating volume 6e83f840-0aef-4091-a1b9-45be195a0000 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:59:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:59:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:59:05 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:59:05 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:59:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:59:05 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:59:05 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:59:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:05 devstack sudo[90288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000 1073741824 Apr 25 15:59:05 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:05 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000 1073741824" returned: 0 in 0.583s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:06 devstack sudo[90293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000 Apr 25 15:59:06 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:06 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000" returned: 0 in 0.418s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:06 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:59:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:59:06 devstack cinder-volume[81828]: DEBUG cinder.volume.volume_utils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Attempting download of 4a29fc86-7ce4-447e-98ea-c141a6c39b3d ((None, [{'url': 'file:///opt/stack/data/glance/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'metadata': {}}])) to volume 6e83f840-0aef-4091-a1b9-45be195a0000. {{(pid=81828) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 25 15:59:06 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a641e83-68aa-4771-89f4-af19796caaeb]: (4, 'raw') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:59:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_9f1z9ow4 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:06 devstack sudo[90296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_9f1z9ow4 Apr 25 15:59:06 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:06 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_9f1z9ow4" returned: 0 in 0.460s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_9f1z9ow4 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:07 devstack sudo[90300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_9f1z9ow4 Apr 25 15:59:07 devstack sudo[90300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:07 devstack sudo[90300]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_9f1z9ow4" returned: 1 in 0.469s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_9f1z9ow4' failed. Not Retrying. {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 25 15:59:07 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cebfcf-73a7-4f4e-a6c7-fe35465f86e4]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:59:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_ymnb8smudevstack@QuobyteHD {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:07 devstack sudo[90304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_ymnb8smudevstack@QuobyteHD Apr 25 15:59:07 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:07 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_ymnb8smudevstack@QuobyteHD" returned: 0 in 0.458s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:07 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] 4a29fc86-7ce4-447e-98ea-c141a6c39b3d was qcow2, converting to raw {{(pid=81828) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 25 15:59:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_ymnb8smudevstack@QuobyteHD /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:07 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_ymnb8smudevstack@QuobyteHD /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000 Apr 25 15:59:07 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:09 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_ymnb8smudevstack@QuobyteHD /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000" returned: 0 in 1.254s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:09 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4a29fc86-7ce4-447e-98ea-c141a6c39b3d_ymnb8smudevstack@QuobyteHD, size 112.00 MB, duration 1.26 sec, destination /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000 {{(pid=81828) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 15:59:09 devstack cinder-volume[81828]: INFO cinder.image.image_utils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Converted 112.00 MB image at 89.24 MB/s Apr 25 15:59:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:09 devstack sudo[90318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000 1G Apr 25 15:59:09 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:09 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000 1G" returned: 0 in 0.472s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:09 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05002f9-680b-4ebe-923f-e8624f4ab896]: (4, 'raw') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:59:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:09 devstack sudo[90323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000 Apr 25 15:59:09 devstack sudo[90323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:10 devstack sudo[90323]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000" returned: 0 in 0.493s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:10 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000 Apr 25 15:59:10 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:10 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000" returned: 1 in 0.484s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000' failed. Not Retrying. {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 25 15:59:10 devstack cinder-volume[81828]: DEBUG cinder.volume.volume_utils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Downloaded image 4a29fc86-7ce4-447e-98ea-c141a6c39b3d ((None, [{'url': 'file:///opt/stack/data/glance/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'metadata': {}}])) to volume 6e83f840-0aef-4091-a1b9-45be195a0000 successfully. {{(pid=81828) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 25 15:59:10 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Temporary image 4a29fc86-7ce4-447e-98ea-c141a6c39b3d for user 9d1c5537d4e6468fa36f9c8cd76df8ab is deleted. {{(pid=81828) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 25 15:59:10 devstack cinder-volume[81828]: DEBUG cinder.volume.volume_utils [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Marking volume 6e83f840-0aef-4091-a1b9-45be195a0000 as bootable. {{(pid=81828) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 25 15:59:10 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Copying metadata from image 4a29fc86-7ce4-447e-98ea-c141a6c39b3d to 6e83f840-0aef-4091-a1b9-45be195a0000. {{(pid=81828) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 25 15:59:10 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Creating volume glance metadata for volume 6e83f840-0aef-4091-a1b9-45be195a0000 backed by image 4a29fc86-7ce4-447e-98ea-c141a6c39b3d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=81828) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 25 15:59:10 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaafcb75-fe7d-4603-8534-c10d82c5e5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e83f840-0aef-4091-a1b9-45be195a0000', 'volume_size': 1, 'image_id': '4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99560f74c63f4b9285294e59133188d8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4a29fc86-7ce4-447e-98ea-c141a6c39b3d', 'created_at': datetime.datetime(2026, 4, 25, 13, 42, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 25, 13, 42, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a29fc86-7ce4-447e-98ea-c141a6c39b3d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:10 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48c0b8ee-9362-4586-87d9-f3ec29a7914b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:10 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Volume volume-6e83f840-0aef-4091-a1b9-45be195a0000 (6e83f840-0aef-4091-a1b9-45be195a0000): created successfully Apr 25 15:59:10 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48c0b8ee-9362-4586-87d9-f3ec29a7914b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:10 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Flow 'volume_create_manager' (5105e7ac-24c6-44de-b965-ca44058dedf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:59:10 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-d4e4b7d6-24c6-4ba2-93a7-be2e8696df6c tempest-VolumesExtendTest-1327107292 None] Created volume successfully. Apr 25 15:59:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-64d9aad2-975e-4e2f-9fc4-1c1a687653fa tempest-VolumesExtendTest-1327107292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:59:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-64d9aad2-975e-4e2f-9fc4-1c1a687653fa tempest-VolumesExtendTest-1327107292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:59:11 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[2609c9e9-b811-4993-9368-2f8548542170]: (4, 'raw') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:59:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-64d9aad2-975e-4e2f-9fc4-1c1a687653fa tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:11 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000 Apr 25 15:59:11 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:11 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-64d9aad2-975e-4e2f-9fc4-1c1a687653fa tempest-VolumesExtendTest-1327107292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000" returned: 0 in 0.473s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-64d9aad2-975e-4e2f-9fc4-1c1a687653fa tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:11 devstack sudo[90337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000 Apr 25 15:59:11 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:12 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-64d9aad2-975e-4e2f-9fc4-1c1a687653fa tempest-VolumesExtendTest-1327107292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000" returned: 1 in 0.487s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-64d9aad2-975e-4e2f-9fc4-1c1a687653fa tempest-VolumesExtendTest-1327107292 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000' failed. Not Retrying. {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 25 15:59:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-64d9aad2-975e-4e2f-9fc4-1c1a687653fa tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000 2G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-64d9aad2-975e-4e2f-9fc4-1c1a687653fa tempest-VolumesExtendTest-1327107292 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000 2G" returned: 0 in 0.059s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-64d9aad2-975e-4e2f-9fc4-1c1a687653fa tempest-VolumesExtendTest-1327107292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.059s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:59:12 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-64d9aad2-975e-4e2f-9fc4-1c1a687653fa tempest-VolumesExtendTest-1327107292 None] Extend volume completed successfully. Apr 25 15:59:13 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-8639cfad-81a9-400f-8ef3-fbbe69c8b387 tempest-VolumesExtendTest-1327107292 None] Acquiring lock "cinder-6e83f840-0aef-4091-a1b9-45be195a0000-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:59:13 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-8639cfad-81a9-400f-8ef3-fbbe69c8b387 tempest-VolumesExtendTest-1327107292 None] Lock "cinder-6e83f840-0aef-4091-a1b9-45be195a0000-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:59:13 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-8639cfad-81a9-400f-8ef3-fbbe69c8b387 tempest-VolumesExtendTest-1327107292 None] Acquiring lock "cinder-quobyte-6e83f840-0aef-4091-a1b9-45be195a0000" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:59:13 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-8639cfad-81a9-400f-8ef3-fbbe69c8b387 tempest-VolumesExtendTest-1327107292 None] Lock "cinder-quobyte-6e83f840-0aef-4091-a1b9-45be195a0000" acquired by "delete_volume" :: waited 0.016s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:59:13 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9661ae-dced-476d-b781-b2f8494a7fb6]: (4, 'raw') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:59:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8639cfad-81a9-400f-8ef3-fbbe69c8b387 tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:13 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000 Apr 25 15:59:13 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:14 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8639cfad-81a9-400f-8ef3-fbbe69c8b387 tempest-VolumesExtendTest-1327107292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000" returned: 0 in 0.491s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8639cfad-81a9-400f-8ef3-fbbe69c8b387 tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:14 devstack sudo[90383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000 Apr 25 15:59:14 devstack sudo[90383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:14 devstack sudo[90383]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8639cfad-81a9-400f-8ef3-fbbe69c8b387 tempest-VolumesExtendTest-1327107292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000" returned: 1 in 0.509s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8639cfad-81a9-400f-8ef3-fbbe69c8b387 tempest-VolumesExtendTest-1327107292 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000' failed. Not Retrying. {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 25 15:59:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8639cfad-81a9-400f-8ef3-fbbe69c8b387 tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:14 devstack sudo[90388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000 Apr 25 15:59:14 devstack sudo[90388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:15 devstack sudo[90388]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8639cfad-81a9-400f-8ef3-fbbe69c8b387 tempest-VolumesExtendTest-1327107292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-6e83f840-0aef-4091-a1b9-45be195a0000" returned: 0 in 0.417s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:15 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-8639cfad-81a9-400f-8ef3-fbbe69c8b387 tempest-VolumesExtendTest-1327107292 None] Lock "cinder-quobyte-6e83f840-0aef-4091-a1b9-45be195a0000" released by "delete_volume" :: held 1.485s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:59:15 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-8639cfad-81a9-400f-8ef3-fbbe69c8b387 tempest-VolumesExtendTest-1327107292 None] Created reservations ['a8109bb7-bc59-4e0f-9eae-072e1b23eee6', '53039d28-340d-4f24-b0c9-b68f50ac8679', '0d0b2047-55e9-4e3d-8e8a-17ac26476e07', 'dff9161c-c913-4fd4-92ac-44e2c639f646'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:59:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-8639cfad-81a9-400f-8ef3-fbbe69c8b387 tempest-VolumesExtendTest-1327107292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:59:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-8639cfad-81a9-400f-8ef3-fbbe69c8b387 tempest-VolumesExtendTest-1327107292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:59:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-8639cfad-81a9-400f-8ef3-fbbe69c8b387 tempest-VolumesExtendTest-1327107292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:59:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-8639cfad-81a9-400f-8ef3-fbbe69c8b387 tempest-VolumesExtendTest-1327107292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:59:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-8639cfad-81a9-400f-8ef3-fbbe69c8b387 tempest-VolumesExtendTest-1327107292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:59:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8639cfad-81a9-400f-8ef3-fbbe69c8b387 tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:15 devstack sudo[90391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:59:15 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:15 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8639cfad-81a9-400f-8ef3-fbbe69c8b387 tempest-VolumesExtendTest-1327107292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.428s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:15 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-8639cfad-81a9-400f-8ef3-fbbe69c8b387 tempest-VolumesExtendTest-1327107292 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:59:15 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-8639cfad-81a9-400f-8ef3-fbbe69c8b387 tempest-VolumesExtendTest-1327107292 None] Deleted volume successfully. Apr 25 15:59:15 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-8639cfad-81a9-400f-8ef3-fbbe69c8b387 tempest-VolumesExtendTest-1327107292 None] Lock "cinder-6e83f840-0aef-4091-a1b9-45be195a0000-delete_volume" released by "delete_volume" :: held 2.095s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:59:16 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:59:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] Flow 'volume_create_manager' (6a21fe56-30ec-4fa0-ac3c-5663fe547cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:59:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4ee8b0-030c-427d-8878-1155737fe547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b4ee8b0-030c-427d-8878-1155737fe547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1020624093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c497b54eb01c46a281aa2be24721e5b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:59:16Z,use_quota=True,user_id='9d1c5537d4e6468fa36f9c8cd76df8ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07d5dfb0-dc1b-4d7f-b8e4-aab7f62f4e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07d5dfb0-dc1b-4d7f-b8e4-aab7f62f4e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (403d00a3-9414-45e6-83e6-917e4fb726c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (403d00a3-9414-45e6-83e6-917e4fb726c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be', 'volume_name': 'volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44f8c4f0-fae6-4773-8483-4522165ba372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44f8c4f0-fae6-4773-8483-4522165ba372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55ab764c-9952-42c9-9d4b-a08d74a093c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:16 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] Volume 9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be', 'volume_size': 1} Apr 25 15:59:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:59:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:59:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1020624093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c497b54eb01c46a281aa2be24721e5b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:59:16Z,use_quota=True,user_id='9d1c5537d4e6468fa36f9c8cd76df8ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:59:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] Creating volume 9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:59:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:59:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:59:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:59:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:59:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:59:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:59:16 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:59:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:16 devstack sudo[90394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be 1073741824 Apr 25 15:59:16 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:16 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be 1073741824" returned: 0 in 0.568s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:16 devstack sudo[90399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be Apr 25 15:59:16 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:17 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be" returned: 0 in 0.449s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:17 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:59:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:59:17 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55ab764c-9952-42c9-9d4b-a08d74a093c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:17 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1acc108b-a829-4120-a687-d667a71fc7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:17 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] Volume volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be (9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be): created successfully Apr 25 15:59:17 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1acc108b-a829-4120-a687-d667a71fc7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:17 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] Flow 'volume_create_manager' (6a21fe56-30ec-4fa0-ac3c-5663fe547cf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:59:17 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-63017e83-97b1-415f-8be2-31bdcd6f1ac3 tempest-VolumesExtendTest-1327107292 None] Created volume successfully. Apr 25 15:59:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-890b84bc-b099-4587-9d95-dcff9e5395ef tempest-VolumesExtendTest-1327107292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:59:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-890b84bc-b099-4587-9d95-dcff9e5395ef tempest-VolumesExtendTest-1327107292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:59:18 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-890b84bc-b099-4587-9d95-dcff9e5395ef tempest-VolumesExtendTest-1327107292 None] Creating offline snapshot bd6ca1db-36b1-45b6-bcaa-eb400275fea7 of volume 9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 15:59:18 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac163c79-96a6-4998-adba-17d8fc4bfd1f]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:59:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-890b84bc-b099-4587-9d95-dcff9e5395ef tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:18 devstack sudo[90402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be Apr 25 15:59:18 devstack sudo[90402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:19 devstack sudo[90402]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-890b84bc-b099-4587-9d95-dcff9e5395ef tempest-VolumesExtendTest-1327107292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be" returned: 0 in 0.507s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-890b84bc-b099-4587-9d95-dcff9e5395ef tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be.bd6ca1db-36b1-45b6-bcaa-eb400275fea7 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:19 devstack sudo[90407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be.bd6ca1db-36b1-45b6-bcaa-eb400275fea7 1G Apr 25 15:59:19 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:19 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-890b84bc-b099-4587-9d95-dcff9e5395ef tempest-VolumesExtendTest-1327107292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be.bd6ca1db-36b1-45b6-bcaa-eb400275fea7 1G" returned: 0 in 0.591s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-890b84bc-b099-4587-9d95-dcff9e5395ef tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be.bd6ca1db-36b1-45b6-bcaa-eb400275fea7 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:19 devstack sudo[90412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be.bd6ca1db-36b1-45b6-bcaa-eb400275fea7 Apr 25 15:59:19 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:20 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-890b84bc-b099-4587-9d95-dcff9e5395ef tempest-VolumesExtendTest-1327107292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be.bd6ca1db-36b1-45b6-bcaa-eb400275fea7" returned: 0 in 0.447s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:20 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-890b84bc-b099-4587-9d95-dcff9e5395ef tempest-VolumesExtendTest-1327107292 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be.bd6ca1db-36b1-45b6-bcaa-eb400275fea7 is being set with open permissions: ugo+rw Apr 25 15:59:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-890b84bc-b099-4587-9d95-dcff9e5395ef tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be.bd6ca1db-36b1-45b6-bcaa-eb400275fea7 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:20 devstack sudo[90417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be.bd6ca1db-36b1-45b6-bcaa-eb400275fea7 Apr 25 15:59:20 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:20 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-890b84bc-b099-4587-9d95-dcff9e5395ef tempest-VolumesExtendTest-1327107292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be.bd6ca1db-36b1-45b6-bcaa-eb400275fea7" returned: 0 in 0.408s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-890b84bc-b099-4587-9d95-dcff9e5395ef tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:20 devstack sudo[90420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be.info Apr 25 15:59:20 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:20 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-890b84bc-b099-4587-9d95-dcff9e5395ef tempest-VolumesExtendTest-1327107292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be.info" returned: 0 in 0.435s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:20 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-890b84bc-b099-4587-9d95-dcff9e5395ef tempest-VolumesExtendTest-1327107292 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be.info is being set with open permissions: ugo+rw Apr 25 15:59:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-890b84bc-b099-4587-9d95-dcff9e5395ef tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:21 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be.info Apr 25 15:59:21 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:21 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-890b84bc-b099-4587-9d95-dcff9e5395ef tempest-VolumesExtendTest-1327107292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be.info" returned: 0 in 0.426s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-890b84bc-b099-4587-9d95-dcff9e5395ef tempest-VolumesExtendTest-1327107292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.900s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:59:21 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-890b84bc-b099-4587-9d95-dcff9e5395ef tempest-VolumesExtendTest-1327107292 None] Create snapshot completed successfully Apr 25 15:59:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7f8e39f9-34eb-460e-a4de-36452bde0ae4 tempest-VolumesExtendTest-1327107292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:59:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7f8e39f9-34eb-460e-a4de-36452bde0ae4 tempest-VolumesExtendTest-1327107292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:59:21 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[f353f0b0-5560-4095-9b9a-aa97cfc12c43]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:59:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7f8e39f9-34eb-460e-a4de-36452bde0ae4 tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:21 devstack sudo[90427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be Apr 25 15:59:21 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:22 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7f8e39f9-34eb-460e-a4de-36452bde0ae4 tempest-VolumesExtendTest-1327107292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be" returned: 0 in 0.501s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7f8e39f9-34eb-460e-a4de-36452bde0ae4 tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be.bd6ca1db-36b1-45b6-bcaa-eb400275fea7 2G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7f8e39f9-34eb-460e-a4de-36452bde0ae4 tempest-VolumesExtendTest-1327107292 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be.bd6ca1db-36b1-45b6-bcaa-eb400275fea7 2G" returned: 0 in 0.120s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7f8e39f9-34eb-460e-a4de-36452bde0ae4 tempest-VolumesExtendTest-1327107292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.650s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:59:22 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-7f8e39f9-34eb-460e-a4de-36452bde0ae4 tempest-VolumesExtendTest-1327107292 None] Extend volume completed successfully. Apr 25 15:59:22 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-34712e8f-7379-4afe-8b09-a3e3792ff129 tempest-VolumesExtendTest-1327107292 None] Acquiring lock "cinder-bd6ca1db-36b1-45b6-bcaa-eb400275fea7-delete_snapshot" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:59:22 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-34712e8f-7379-4afe-8b09-a3e3792ff129 tempest-VolumesExtendTest-1327107292 None] Lock "cinder-bd6ca1db-36b1-45b6-bcaa-eb400275fea7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:59:22 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-34712e8f-7379-4afe-8b09-a3e3792ff129 tempest-VolumesExtendTest-1327107292 None] Acquiring lock "cinder-quobyte-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:59:22 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-34712e8f-7379-4afe-8b09-a3e3792ff129 tempest-VolumesExtendTest-1327107292 None] Lock "cinder-quobyte-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:59:22 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-34712e8f-7379-4afe-8b09-a3e3792ff129 tempest-VolumesExtendTest-1327107292 None] Acquiring lock "cinder-quobyte-bd6ca1db-36b1-45b6-bcaa-eb400275fea7" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:59:22 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-34712e8f-7379-4afe-8b09-a3e3792ff129 tempest-VolumesExtendTest-1327107292 None] Lock "cinder-quobyte-bd6ca1db-36b1-45b6-bcaa-eb400275fea7" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:59:22 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-34712e8f-7379-4afe-8b09-a3e3792ff129 tempest-VolumesExtendTest-1327107292 None] Deleting offline snapshot bd6ca1db-36b1-45b6-bcaa-eb400275fea7 of volume 9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 15:59:23 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-34712e8f-7379-4afe-8b09-a3e3792ff129 tempest-VolumesExtendTest-1327107292 None] snapshot_file for this snap is: volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be.bd6ca1db-36b1-45b6-bcaa-eb400275fea7 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 15:59:23 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcb679b-9dcf-4467-8b6f-0f5e7d985d9e]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:59:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-34712e8f-7379-4afe-8b09-a3e3792ff129 tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be.bd6ca1db-36b1-45b6-bcaa-eb400275fea7 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:23 devstack sudo[90435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be.bd6ca1db-36b1-45b6-bcaa-eb400275fea7 Apr 25 15:59:23 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:23 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-34712e8f-7379-4afe-8b09-a3e3792ff129 tempest-VolumesExtendTest-1327107292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be.bd6ca1db-36b1-45b6-bcaa-eb400275fea7" returned: 0 in 0.507s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:23 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-34712e8f-7379-4afe-8b09-a3e3792ff129 tempest-VolumesExtendTest-1327107292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:59:23 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d214cb9-80fe-4ced-8770-9e7d6b950311]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:59:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-34712e8f-7379-4afe-8b09-a3e3792ff129 tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:23 devstack sudo[90440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be Apr 25 15:59:23 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:24 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-34712e8f-7379-4afe-8b09-a3e3792ff129 tempest-VolumesExtendTest-1327107292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be" returned: 0 in 0.513s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-34712e8f-7379-4afe-8b09-a3e3792ff129 tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be.bd6ca1db-36b1-45b6-bcaa-eb400275fea7 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:24 devstack sudo[90445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be.bd6ca1db-36b1-45b6-bcaa-eb400275fea7 Apr 25 15:59:24 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:24 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-34712e8f-7379-4afe-8b09-a3e3792ff129 tempest-VolumesExtendTest-1327107292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be.bd6ca1db-36b1-45b6-bcaa-eb400275fea7" returned: 0 in 0.553s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-34712e8f-7379-4afe-8b09-a3e3792ff129 tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be.bd6ca1db-36b1-45b6-bcaa-eb400275fea7 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:24 devstack sudo[90450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be.bd6ca1db-36b1-45b6-bcaa-eb400275fea7 Apr 25 15:59:24 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:25 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-34712e8f-7379-4afe-8b09-a3e3792ff129 tempest-VolumesExtendTest-1327107292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be.bd6ca1db-36b1-45b6-bcaa-eb400275fea7" returned: 0 in 0.433s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:25 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-34712e8f-7379-4afe-8b09-a3e3792ff129 tempest-VolumesExtendTest-1327107292 None] Lock "cinder-quobyte-bd6ca1db-36b1-45b6-bcaa-eb400275fea7" released by "_delete_snapshot" :: held 2.104s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:59:25 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-34712e8f-7379-4afe-8b09-a3e3792ff129 tempest-VolumesExtendTest-1327107292 None] Lock "cinder-quobyte-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be" released by "delete_snapshot" :: held 2.124s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:59:25 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-34712e8f-7379-4afe-8b09-a3e3792ff129 tempest-VolumesExtendTest-1327107292 None] Created reservations ['e0605353-6cc8-4b63-90d5-2ee864fa9648', '25c5ace5-1100-4125-9c1f-a29311c3ec14', '07342e1d-bf85-4539-a20b-9c86d588116e', 'be9e6621-4c57-4ac9-a937-75b86c010ba3'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:59:25 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-34712e8f-7379-4afe-8b09-a3e3792ff129 tempest-VolumesExtendTest-1327107292 None] Delete snapshot completed successfully. Apr 25 15:59:25 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-34712e8f-7379-4afe-8b09-a3e3792ff129 tempest-VolumesExtendTest-1327107292 None] Lock "cinder-bd6ca1db-36b1-45b6-bcaa-eb400275fea7-delete_snapshot" released by "delete_snapshot" :: held 2.248s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:59:26 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e6e657d5-8e09-4127-bf0a-133a1fd987c8 tempest-VolumesExtendTest-1327107292 None] Acquiring lock "cinder-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:59:26 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e6e657d5-8e09-4127-bf0a-133a1fd987c8 tempest-VolumesExtendTest-1327107292 None] Lock "cinder-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:59:26 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e6e657d5-8e09-4127-bf0a-133a1fd987c8 tempest-VolumesExtendTest-1327107292 None] Acquiring lock "cinder-quobyte-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:59:26 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e6e657d5-8e09-4127-bf0a-133a1fd987c8 tempest-VolumesExtendTest-1327107292 None] Lock "cinder-quobyte-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be" acquired by "delete_volume" :: waited 0.018s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:59:26 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea223c1a-3dc2-4eeb-887b-2e63efae2b6b]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:59:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e6e657d5-8e09-4127-bf0a-133a1fd987c8 tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:26 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be Apr 25 15:59:26 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:26 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e6e657d5-8e09-4127-bf0a-133a1fd987c8 tempest-VolumesExtendTest-1327107292 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be" returned: 0 in 0.517s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e6e657d5-8e09-4127-bf0a-133a1fd987c8 tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:26 devstack sudo[90458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be Apr 25 15:59:26 devstack sudo[90458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:27 devstack sudo[90458]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e6e657d5-8e09-4127-bf0a-133a1fd987c8 tempest-VolumesExtendTest-1327107292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be" returned: 0 in 0.431s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:27 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e6e657d5-8e09-4127-bf0a-133a1fd987c8 tempest-VolumesExtendTest-1327107292 None] Lock "cinder-quobyte-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be" released by "delete_volume" :: held 1.008s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:59:27 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-e6e657d5-8e09-4127-bf0a-133a1fd987c8 tempest-VolumesExtendTest-1327107292 None] Created reservations ['2cae9082-3086-4661-88b8-9ef025a8eb9b', '28eae62d-4821-42aa-99b8-2d7f4b4aa8b4', 'ceb93d33-33c5-401a-877c-ea442fda86ad', '6a21cc36-14fb-46d4-9b35-e1d9ab4c3473'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:59:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e6e657d5-8e09-4127-bf0a-133a1fd987c8 tempest-VolumesExtendTest-1327107292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:59:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e6e657d5-8e09-4127-bf0a-133a1fd987c8 tempest-VolumesExtendTest-1327107292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:59:27 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e6e657d5-8e09-4127-bf0a-133a1fd987c8 tempest-VolumesExtendTest-1327107292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:59:27 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e6e657d5-8e09-4127-bf0a-133a1fd987c8 tempest-VolumesExtendTest-1327107292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:59:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e6e657d5-8e09-4127-bf0a-133a1fd987c8 tempest-VolumesExtendTest-1327107292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:59:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e6e657d5-8e09-4127-bf0a-133a1fd987c8 tempest-VolumesExtendTest-1327107292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:27 devstack sudo[90461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:59:27 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:27 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e6e657d5-8e09-4127-bf0a-133a1fd987c8 tempest-VolumesExtendTest-1327107292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.440s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:27 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-e6e657d5-8e09-4127-bf0a-133a1fd987c8 tempest-VolumesExtendTest-1327107292 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:59:27 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-e6e657d5-8e09-4127-bf0a-133a1fd987c8 tempest-VolumesExtendTest-1327107292 None] Deleted volume successfully. Apr 25 15:59:27 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e6e657d5-8e09-4127-bf0a-133a1fd987c8 tempest-VolumesExtendTest-1327107292 None] Lock "cinder-9788ccb8-cecf-4d3f-b6d2-d0189ae2c1be-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:59:30 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:59:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Flow 'volume_create_manager' (092b2949-ff6c-4cd5-a9d0-d5394c3cbf99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:59:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39e06cb5-edf0-4c1c-8638-6516a88bd3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39e06cb5-edf0-4c1c-8638-6516a88bd3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1570948356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a71b80-d5bb-44df-bd85-a2c2bc840bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dd99881d1ec4082af5383bf6f9f3053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:59:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:59:31Z,use_quota=True,user_id='9ebf49b1c57346118b5302bcef9baa63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b470ade-b231-490f-8b39-e2ac082c290b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b470ade-b231-490f-8b39-e2ac082c290b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9a6da1-815f-4540-a486-63579ba57671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9a6da1-815f-4540-a486-63579ba57671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81a71b80-d5bb-44df-bd85-a2c2bc840bb8', 'volume_name': 'volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8', 'volume_size': 2}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1984c79-0f55-45b4-81e1-faea22ea2e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1984c79-0f55-45b4-81e1-faea22ea2e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9b59eb-2d17-4fa5-9e94-47f690a45cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:30 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Volume 81a71b80-d5bb-44df-bd85-a2c2bc840bb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8', 'volume_size': 2} Apr 25 15:59:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:59:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:59:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1570948356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81a71b80-d5bb-44df-bd85-a2c2bc840bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6dd99881d1ec4082af5383bf6f9f3053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:59:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:59:31Z,use_quota=True,user_id='9ebf49b1c57346118b5302bcef9baa63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:59:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Creating volume 81a71b80-d5bb-44df-bd85-a2c2bc840bb8 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:59:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:59:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:59:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:59:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:59:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:59:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:59:30 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:59:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8 2147483648 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:30 devstack sudo[90464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8 2147483648 Apr 25 15:59:30 devstack sudo[90464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:31 devstack sudo[90464]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8 2147483648" returned: 0 in 0.617s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:31 devstack sudo[90470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8 Apr 25 15:59:31 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:31 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8" returned: 0 in 0.453s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:31 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:59:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:59:32 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c9b59eb-2d17-4fa5-9e94-47f690a45cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8', 'volume_size': 2}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:32 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8647cdc8-90df-4c66-9745-7da1519883f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:32 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Volume volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8 (81a71b80-d5bb-44df-bd85-a2c2bc840bb8): created successfully Apr 25 15:59:32 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8647cdc8-90df-4c66-9745-7da1519883f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:32 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Flow 'volume_create_manager' (092b2949-ff6c-4cd5-a9d0-d5394c3cbf99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:59:32 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-692d88a2-5727-400e-b76b-5b59da03d693 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Created volume successfully. Apr 25 15:59:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f1b82a3e-43f9-4115-b2e0-9b4f054a2d78 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:59:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f1b82a3e-43f9-4115-b2e0-9b4f054a2d78 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:59:33 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-f1b82a3e-43f9-4115-b2e0-9b4f054a2d78 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Creating offline snapshot 1b0e490c-4941-48ac-aa2d-bd31f7c29a54 of volume 81a71b80-d5bb-44df-bd85-a2c2bc840bb8 {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 15:59:33 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5019976-f1c1-4acd-b492-0ada0970b7d9]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:59:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f1b82a3e-43f9-4115-b2e0-9b4f054a2d78 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:33 devstack sudo[90474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8 Apr 25 15:59:33 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:33 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f1b82a3e-43f9-4115-b2e0-9b4f054a2d78 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8" returned: 0 in 0.520s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f1b82a3e-43f9-4115-b2e0-9b4f054a2d78 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8.1b0e490c-4941-48ac-aa2d-bd31f7c29a54 2G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:33 devstack sudo[90479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8.1b0e490c-4941-48ac-aa2d-bd31f7c29a54 2G Apr 25 15:59:33 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:34 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f1b82a3e-43f9-4115-b2e0-9b4f054a2d78 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8.1b0e490c-4941-48ac-aa2d-bd31f7c29a54 2G" returned: 0 in 0.583s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f1b82a3e-43f9-4115-b2e0-9b4f054a2d78 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8.1b0e490c-4941-48ac-aa2d-bd31f7c29a54 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:34 devstack sudo[90484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8.1b0e490c-4941-48ac-aa2d-bd31f7c29a54 Apr 25 15:59:34 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:34 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f1b82a3e-43f9-4115-b2e0-9b4f054a2d78 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8.1b0e490c-4941-48ac-aa2d-bd31f7c29a54" returned: 0 in 0.492s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:34 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-f1b82a3e-43f9-4115-b2e0-9b4f054a2d78 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8.1b0e490c-4941-48ac-aa2d-bd31f7c29a54 is being set with open permissions: ugo+rw Apr 25 15:59:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f1b82a3e-43f9-4115-b2e0-9b4f054a2d78 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8.1b0e490c-4941-48ac-aa2d-bd31f7c29a54 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:34 devstack sudo[90489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8.1b0e490c-4941-48ac-aa2d-bd31f7c29a54 Apr 25 15:59:34 devstack sudo[90489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:35 devstack sudo[90489]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f1b82a3e-43f9-4115-b2e0-9b4f054a2d78 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8.1b0e490c-4941-48ac-aa2d-bd31f7c29a54" returned: 0 in 0.437s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f1b82a3e-43f9-4115-b2e0-9b4f054a2d78 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:35 devstack sudo[90492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8.info Apr 25 15:59:35 devstack sudo[90492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:35 devstack sudo[90492]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f1b82a3e-43f9-4115-b2e0-9b4f054a2d78 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8.info" returned: 0 in 0.436s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:35 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-f1b82a3e-43f9-4115-b2e0-9b4f054a2d78 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8.info is being set with open permissions: ugo+rw Apr 25 15:59:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f1b82a3e-43f9-4115-b2e0-9b4f054a2d78 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:35 devstack sudo[90495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8.info Apr 25 15:59:35 devstack sudo[90495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:36 devstack sudo[90495]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f1b82a3e-43f9-4115-b2e0-9b4f054a2d78 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8.info" returned: 0 in 0.431s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f1b82a3e-43f9-4115-b2e0-9b4f054a2d78 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.981s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:59:36 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-f1b82a3e-43f9-4115-b2e0-9b4f054a2d78 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Create snapshot completed successfully Apr 25 15:59:36 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-8f975df9-f31c-48fe-96ca-5b126d33bea2 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Acquiring lock "cinder-1b0e490c-4941-48ac-aa2d-bd31f7c29a54-delete_snapshot" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:59:36 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-8f975df9-f31c-48fe-96ca-5b126d33bea2 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Lock "cinder-1b0e490c-4941-48ac-aa2d-bd31f7c29a54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:59:36 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-8f975df9-f31c-48fe-96ca-5b126d33bea2 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Acquiring lock "cinder-quobyte-81a71b80-d5bb-44df-bd85-a2c2bc840bb8" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:59:36 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-8f975df9-f31c-48fe-96ca-5b126d33bea2 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Lock "cinder-quobyte-81a71b80-d5bb-44df-bd85-a2c2bc840bb8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:59:36 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-8f975df9-f31c-48fe-96ca-5b126d33bea2 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Acquiring lock "cinder-quobyte-1b0e490c-4941-48ac-aa2d-bd31f7c29a54" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:59:36 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-8f975df9-f31c-48fe-96ca-5b126d33bea2 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Lock "cinder-quobyte-1b0e490c-4941-48ac-aa2d-bd31f7c29a54" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:59:36 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-8f975df9-f31c-48fe-96ca-5b126d33bea2 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Deleting offline snapshot 1b0e490c-4941-48ac-aa2d-bd31f7c29a54 of volume 81a71b80-d5bb-44df-bd85-a2c2bc840bb8 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 15:59:36 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-8f975df9-f31c-48fe-96ca-5b126d33bea2 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] snapshot_file for this snap is: volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8.1b0e490c-4941-48ac-aa2d-bd31f7c29a54 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 15:59:36 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf2c293-11f9-4852-a9d4-d16f36c9235f]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:59:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8f975df9-f31c-48fe-96ca-5b126d33bea2 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8.1b0e490c-4941-48ac-aa2d-bd31f7c29a54 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:36 devstack sudo[90498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8.1b0e490c-4941-48ac-aa2d-bd31f7c29a54 Apr 25 15:59:36 devstack sudo[90498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:36 devstack sudo[90498]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8f975df9-f31c-48fe-96ca-5b126d33bea2 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8.1b0e490c-4941-48ac-aa2d-bd31f7c29a54" returned: 0 in 0.488s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:36 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-8f975df9-f31c-48fe-96ca-5b126d33bea2 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 15:59:36 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b1f6ea-cddf-4fc1-a1a2-6b7fa0f9e840]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:59:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8f975df9-f31c-48fe-96ca-5b126d33bea2 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:36 devstack sudo[90503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8 Apr 25 15:59:36 devstack sudo[90503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:37 devstack sudo[90503]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8f975df9-f31c-48fe-96ca-5b126d33bea2 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8" returned: 0 in 0.509s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8f975df9-f31c-48fe-96ca-5b126d33bea2 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8.1b0e490c-4941-48ac-aa2d-bd31f7c29a54 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:37 devstack sudo[90508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8.1b0e490c-4941-48ac-aa2d-bd31f7c29a54 Apr 25 15:59:37 devstack sudo[90508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:37 devstack sudo[90508]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8f975df9-f31c-48fe-96ca-5b126d33bea2 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8.1b0e490c-4941-48ac-aa2d-bd31f7c29a54" returned: 0 in 0.524s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8f975df9-f31c-48fe-96ca-5b126d33bea2 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8.1b0e490c-4941-48ac-aa2d-bd31f7c29a54 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:37 devstack sudo[90513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8.1b0e490c-4941-48ac-aa2d-bd31f7c29a54 Apr 25 15:59:37 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:38 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8f975df9-f31c-48fe-96ca-5b126d33bea2 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8.1b0e490c-4941-48ac-aa2d-bd31f7c29a54" returned: 0 in 0.436s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:38 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-8f975df9-f31c-48fe-96ca-5b126d33bea2 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Lock "cinder-quobyte-1b0e490c-4941-48ac-aa2d-bd31f7c29a54" released by "_delete_snapshot" :: held 2.056s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:59:38 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-8f975df9-f31c-48fe-96ca-5b126d33bea2 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Lock "cinder-quobyte-81a71b80-d5bb-44df-bd85-a2c2bc840bb8" released by "delete_snapshot" :: held 2.078s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:59:38 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-8f975df9-f31c-48fe-96ca-5b126d33bea2 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Created reservations ['aba5c3a4-d793-467c-9ace-f3867f7e1ce6', 'fbaada21-e7e6-4ce7-9773-9e2a6385725d', 'c23f479b-4cd8-4463-8771-af8060ecf09b', 'ce9411b5-04c3-42b9-8bd1-95ecaf80a4e0'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:59:38 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-8f975df9-f31c-48fe-96ca-5b126d33bea2 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Delete snapshot completed successfully. Apr 25 15:59:38 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-8f975df9-f31c-48fe-96ca-5b126d33bea2 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Lock "cinder-1b0e490c-4941-48ac-aa2d-bd31f7c29a54-delete_snapshot" released by "delete_snapshot" :: held 2.203s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:59:39 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fff757fd-dc47-4564-a61e-c39c249f4fc6 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Acquiring lock "cinder-81a71b80-d5bb-44df-bd85-a2c2bc840bb8-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:59:39 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fff757fd-dc47-4564-a61e-c39c249f4fc6 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Lock "cinder-81a71b80-d5bb-44df-bd85-a2c2bc840bb8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:59:39 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fff757fd-dc47-4564-a61e-c39c249f4fc6 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Acquiring lock "cinder-quobyte-81a71b80-d5bb-44df-bd85-a2c2bc840bb8" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:59:39 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fff757fd-dc47-4564-a61e-c39c249f4fc6 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Lock "cinder-quobyte-81a71b80-d5bb-44df-bd85-a2c2bc840bb8" acquired by "delete_volume" :: waited 0.015s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:59:39 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[8935d219-bad4-4701-b105-2822b5095670]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:59:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fff757fd-dc47-4564-a61e-c39c249f4fc6 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:39 devstack sudo[90516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8 Apr 25 15:59:39 devstack sudo[90516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:40 devstack sudo[90516]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fff757fd-dc47-4564-a61e-c39c249f4fc6 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8" returned: 0 in 0.499s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fff757fd-dc47-4564-a61e-c39c249f4fc6 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:40 devstack sudo[90522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8 Apr 25 15:59:40 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:40 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fff757fd-dc47-4564-a61e-c39c249f4fc6 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81a71b80-d5bb-44df-bd85-a2c2bc840bb8" returned: 0 in 0.415s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:40 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fff757fd-dc47-4564-a61e-c39c249f4fc6 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Lock "cinder-quobyte-81a71b80-d5bb-44df-bd85-a2c2bc840bb8" released by "delete_volume" :: held 0.973s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:59:40 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:UPDATE=46,cinder:SELECT=50,cinder:INSERT=21,cinder:DELETE=3 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:59:40 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:SELECT=58,cinder:UPDATE=64,cinder:INSERT=17,cinder:DELETE=5 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 15:59:40 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-fff757fd-dc47-4564-a61e-c39c249f4fc6 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Created reservations ['28874f86-1e11-4ee0-8c1f-5fc8eef5302e', 'bd968471-01a8-44a8-ab27-9732be7ce26f', 'aa2e7cd2-7a89-4eb6-b586-cb826f83baae', 'd2365900-c657-4f2b-ae72-3bd8f875b349'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:59:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fff757fd-dc47-4564-a61e-c39c249f4fc6 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:59:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fff757fd-dc47-4564-a61e-c39c249f4fc6 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:59:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-fff757fd-dc47-4564-a61e-c39c249f4fc6 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:59:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-fff757fd-dc47-4564-a61e-c39c249f4fc6 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:59:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fff757fd-dc47-4564-a61e-c39c249f4fc6 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:59:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fff757fd-dc47-4564-a61e-c39c249f4fc6 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:40 devstack sudo[90525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:59:40 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:41 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fff757fd-dc47-4564-a61e-c39c249f4fc6 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.420s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:41 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-fff757fd-dc47-4564-a61e-c39c249f4fc6 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:59:41 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-fff757fd-dc47-4564-a61e-c39c249f4fc6 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Deleted volume successfully. Apr 25 15:59:41 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fff757fd-dc47-4564-a61e-c39c249f4fc6 tempest-VolumesSnapshotNegativeTestJSON-1873553146 None] Lock "cinder-81a71b80-d5bb-44df-bd85-a2c2bc840bb8-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:59:43 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:59:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Flow 'volume_create_manager' (52c26023-bea0-4162-b2be-c58f0d29e4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:59:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e16a314-56c1-405a-b3f6-49030ffa33c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e16a314-56c1-405a-b3f6-49030ffa33c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-278028318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cebca84-74cd-4055-a925-6f0409e091fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c72a7f0366c4f08ab5eeff285d54630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:59:44Z,use_quota=True,user_id='afb002ff016744c688c800a47eabc918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5863c8fd-682d-4988-8bdd-ee791661b838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5863c8fd-682d-4988-8bdd-ee791661b838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5ea147d-76ff-4fa6-a21b-f12beb655a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5ea147d-76ff-4fa6-a21b-f12beb655a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cebca84-74cd-4055-a925-6f0409e091fb', 'volume_name': 'volume-8cebca84-74cd-4055-a925-6f0409e091fb', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ea94a8-32ba-4d99-8de8-6615447d30cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79ea94a8-32ba-4d99-8de8-6615447d30cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99c90ebf-db4a-41fa-83f3-4de35aaa8bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:44 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Volume 8cebca84-74cd-4055-a925-6f0409e091fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cebca84-74cd-4055-a925-6f0409e091fb', 'volume_size': 1} Apr 25 15:59:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:59:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:59:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-278028318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cebca84-74cd-4055-a925-6f0409e091fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c72a7f0366c4f08ab5eeff285d54630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:59:44Z,use_quota=True,user_id='afb002ff016744c688c800a47eabc918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:59:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Creating volume 8cebca84-74cd-4055-a925-6f0409e091fb {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:59:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:59:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:59:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:59:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:59:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:59:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:59:44 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:59:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8cebca84-74cd-4055-a925-6f0409e091fb 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:44 devstack sudo[90531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8cebca84-74cd-4055-a925-6f0409e091fb 1073741824 Apr 25 15:59:44 devstack sudo[90531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:44 devstack sudo[90531]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8cebca84-74cd-4055-a925-6f0409e091fb 1073741824" returned: 0 in 0.575s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8cebca84-74cd-4055-a925-6f0409e091fb {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:44 devstack sudo[90536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8cebca84-74cd-4055-a925-6f0409e091fb Apr 25 15:59:44 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:45 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8cebca84-74cd-4055-a925-6f0409e091fb" returned: 0 in 0.436s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:45 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:59:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:59:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99c90ebf-db4a-41fa-83f3-4de35aaa8bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cebca84-74cd-4055-a925-6f0409e091fb', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94fa3f79-ec0c-415d-89f2-1dbad42e47b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:45 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Volume volume-8cebca84-74cd-4055-a925-6f0409e091fb (8cebca84-74cd-4055-a925-6f0409e091fb): created successfully Apr 25 15:59:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94fa3f79-ec0c-415d-89f2-1dbad42e47b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Flow 'volume_create_manager' (52c26023-bea0-4162-b2be-c58f0d29e4e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:59:45 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-e7c2ddc9-c797-4b4c-a7b2-49c2652b615b tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Created volume successfully. Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Flow 'volume_create_manager' (b092a815-0733-46ae-af73-4a9d9ff30395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7d55fc0-5e44-495f-922b-8581cf819c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7d55fc0-5e44-495f-922b-8581cf819c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-795779462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed39fae7-1885-4697-a896-3375449f2e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c72a7f0366c4f08ab5eeff285d54630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:59:46Z,use_quota=True,user_id='afb002ff016744c688c800a47eabc918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf02935-8949-4a2c-aa56-30d4d30296ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf02935-8949-4a2c-aa56-30d4d30296ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f41aa66-72ed-41d2-90df-b67a6f9b1cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f41aa66-72ed-41d2-90df-b67a6f9b1cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed39fae7-1885-4697-a896-3375449f2e2e', 'volume_name': 'volume-ed39fae7-1885-4697-a896-3375449f2e2e', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad5801ec-6bdc-4c34-b96a-ceedd1c55695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad5801ec-6bdc-4c34-b96a-ceedd1c55695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e464b5e-aced-43d6-8bfd-72d99b7fb3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:46 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Volume ed39fae7-1885-4697-a896-3375449f2e2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed39fae7-1885-4697-a896-3375449f2e2e', 'volume_size': 1} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-795779462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed39fae7-1885-4697-a896-3375449f2e2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c72a7f0366c4f08ab5eeff285d54630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:59:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:59:46Z,use_quota=True,user_id='afb002ff016744c688c800a47eabc918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Creating volume ed39fae7-1885-4697-a896-3375449f2e2e {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:59:46 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ed39fae7-1885-4697-a896-3375449f2e2e 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:46 devstack sudo[90539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ed39fae7-1885-4697-a896-3375449f2e2e 1073741824 Apr 25 15:59:46 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Flow 'volume_create_manager' (fced8ab0-a882-4712-bf12-285b7651c6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58e3447e-05a6-4b29-ad9a-0ab52cd9ba64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58e3447e-05a6-4b29-ad9a-0ab52cd9ba64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-248998984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e81b308-b45c-4ab9-a8fd-d21da9adf9c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c72a7f0366c4f08ab5eeff285d54630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:59:47Z,use_quota=True,user_id='afb002ff016744c688c800a47eabc918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23fabe2e-d92f-45b3-ae89-d9583a6decf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23fabe2e-d92f-45b3-ae89-d9583a6decf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf995ee-dc34-48e0-80ab-1da0a2a43958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abf995ee-dc34-48e0-80ab-1da0a2a43958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e81b308-b45c-4ab9-a8fd-d21da9adf9c2', 'volume_name': 'volume-5e81b308-b45c-4ab9-a8fd-d21da9adf9c2', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4094480-bec5-4d7c-8aa6-54eebf1c5461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4094480-bec5-4d7c-8aa6-54eebf1c5461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c09eff6-f674-40f4-b471-64cf84eae0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:46 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Volume 5e81b308-b45c-4ab9-a8fd-d21da9adf9c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e81b308-b45c-4ab9-a8fd-d21da9adf9c2', 'volume_size': 1} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Flow 'volume_create_manager' (efedb97e-364b-4a6f-867b-f6efb6adec59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f903856-ef25-4243-b6c9-c7b29f137c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f903856-ef25-4243-b6c9-c7b29f137c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2055965725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99aabab5-d94d-4770-b358-aa0c47af8c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c72a7f0366c4f08ab5eeff285d54630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:59:47Z,use_quota=True,user_id='afb002ff016744c688c800a47eabc918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae33565-8001-4f49-9cf4-b37fce2b2138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae33565-8001-4f49-9cf4-b37fce2b2138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c2ee4cd-bb27-4075-b612-635e17723205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c2ee4cd-bb27-4075-b612-635e17723205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99aabab5-d94d-4770-b358-aa0c47af8c42', 'volume_name': 'volume-99aabab5-d94d-4770-b358-aa0c47af8c42', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25b0da5f-f435-4178-8080-894a21e6c4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25b0da5f-f435-4178-8080-894a21e6c4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b4a4a35-7b7a-4dc6-b77c-240a69080e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:46 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Volume 99aabab5-d94d-4770-b358-aa0c47af8c42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99aabab5-d94d-4770-b358-aa0c47af8c42', 'volume_size': 1} Apr 25 15:59:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:59:47 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ed39fae7-1885-4697-a896-3375449f2e2e 1073741824" returned: 0 in 0.729s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Flow 'volume_create_manager' (8b59649d-366a-450e-b823-a8368ec7ca36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4886509-6b16-4b9f-976a-54b8b2918af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ed39fae7-1885-4697-a896-3375449f2e2e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:47 devstack sudo[90544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ed39fae7-1885-4697-a896-3375449f2e2e Apr 25 15:59:47 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4886509-6b16-4b9f-976a-54b8b2918af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1444589188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b11c675-a87a-41a0-b07c-7f6d35d46d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c72a7f0366c4f08ab5eeff285d54630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:59:47Z,use_quota=True,user_id='afb002ff016744c688c800a47eabc918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff69a40-425b-4eb1-be11-53dff93b3193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff69a40-425b-4eb1-be11-53dff93b3193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15025729-fde4-4702-a8ab-1372a081eaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15025729-fde4-4702-a8ab-1372a081eaf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b11c675-a87a-41a0-b07c-7f6d35d46d0b', 'volume_name': 'volume-0b11c675-a87a-41a0-b07c-7f6d35d46d0b', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71de9806-ffc4-469a-93d8-4ea129fa5d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71de9806-ffc4-469a-93d8-4ea129fa5d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6579f9bf-410b-4e8b-8c73-ae51fea1d86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:47 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Volume 0b11c675-a87a-41a0-b07c-7f6d35d46d0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b11c675-a87a-41a0-b07c-7f6d35d46d0b', 'volume_size': 1} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Flow 'volume_create_manager' (c8c21208-5763-44ab-b00a-15cb915dd470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c4f126e-2b93-4d76-8b57-a2543fbcf2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c4f126e-2b93-4d76-8b57-a2543fbcf2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1097448004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c63234f2-95cc-461e-a50b-12d0cbdd7d1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c72a7f0366c4f08ab5eeff285d54630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:59:47Z,use_quota=True,user_id='afb002ff016744c688c800a47eabc918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ea2fde8-8886-4e62-8eb7-4635f339f852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ea2fde8-8886-4e62-8eb7-4635f339f852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ff5b14-ebfa-4ca6-83d7-1720b47731f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ff5b14-ebfa-4ca6-83d7-1720b47731f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c63234f2-95cc-461e-a50b-12d0cbdd7d1e', 'volume_name': 'volume-c63234f2-95cc-461e-a50b-12d0cbdd7d1e', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d017999-d0c7-45d1-b62d-dc61d5bd0638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d017999-d0c7-45d1-b62d-dc61d5bd0638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4797242d-4182-4e12-b645-f3067512c6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:47 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Volume c63234f2-95cc-461e-a50b-12d0cbdd7d1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c63234f2-95cc-461e-a50b-12d0cbdd7d1e', 'volume_size': 1} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:59:47 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ed39fae7-1885-4697-a896-3375449f2e2e" returned: 0 in 0.492s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.041s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:59:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-248998984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e81b308-b45c-4ab9-a8fd-d21da9adf9c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c72a7f0366c4f08ab5eeff285d54630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:59:47Z,use_quota=True,user_id='afb002ff016744c688c800a47eabc918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Creating volume 5e81b308-b45c-4ab9-a8fd-d21da9adf9c2 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:59:47 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5e81b308-b45c-4ab9-a8fd-d21da9adf9c2 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e464b5e-aced-43d6-8bfd-72d99b7fb3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed39fae7-1885-4697-a896-3375449f2e2e', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08d90cbe-c9f1-4da9-bb36-c62679d9511d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:47 devstack sudo[90547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5e81b308-b45c-4ab9-a8fd-d21da9adf9c2 1073741824 Apr 25 15:59:47 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:47 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Volume volume-ed39fae7-1885-4697-a896-3375449f2e2e (ed39fae7-1885-4697-a896-3375449f2e2e): created successfully Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08d90cbe-c9f1-4da9-bb36-c62679d9511d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Flow 'volume_create_manager' (b092a815-0733-46ae-af73-4a9d9ff30395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:59:47 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-663f2165-65ef-4b7f-a8bd-9663fcf55dbc tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Created volume successfully. Apr 25 15:59:48 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5e81b308-b45c-4ab9-a8fd-d21da9adf9c2 1073741824" returned: 0 in 0.587s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5e81b308-b45c-4ab9-a8fd-d21da9adf9c2 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:48 devstack sudo[90552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5e81b308-b45c-4ab9-a8fd-d21da9adf9c2 Apr 25 15:59:48 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:48 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5e81b308-b45c-4ab9-a8fd-d21da9adf9c2" returned: 0 in 0.430s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:48 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:59:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:59:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.810s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:59:48 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2055965725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99aabab5-d94d-4770-b358-aa0c47af8c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c72a7f0366c4f08ab5eeff285d54630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:59:47Z,use_quota=True,user_id='afb002ff016744c688c800a47eabc918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:59:48 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Creating volume 99aabab5-d94d-4770-b358-aa0c47af8c42 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:59:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:59:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:59:48 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:59:48 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:59:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:59:48 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:59:48 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:59:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99aabab5-d94d-4770-b358-aa0c47af8c42 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c09eff6-f674-40f4-b471-64cf84eae0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e81b308-b45c-4ab9-a8fd-d21da9adf9c2', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec70672c-4193-467e-89ed-9934c19c0e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:48 devstack sudo[90555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99aabab5-d94d-4770-b358-aa0c47af8c42 1073741824 Apr 25 15:59:48 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:48 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Volume volume-5e81b308-b45c-4ab9-a8fd-d21da9adf9c2 (5e81b308-b45c-4ab9-a8fd-d21da9adf9c2): created successfully Apr 25 15:59:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec70672c-4193-467e-89ed-9934c19c0e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Flow 'volume_create_manager' (fced8ab0-a882-4712-bf12-285b7651c6ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:59:48 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-73a1f2c0-9aae-4118-b1a6-f51e69dedd1a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Created volume successfully. Apr 25 15:59:49 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99aabab5-d94d-4770-b358-aa0c47af8c42 1073741824" returned: 0 in 0.613s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99aabab5-d94d-4770-b358-aa0c47af8c42 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:49 devstack sudo[90560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99aabab5-d94d-4770-b358-aa0c47af8c42 Apr 25 15:59:49 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:49 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99aabab5-d94d-4770-b358-aa0c47af8c42" returned: 0 in 0.451s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:49 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:59:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:59:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.615s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:59:49 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1444589188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b11c675-a87a-41a0-b07c-7f6d35d46d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c72a7f0366c4f08ab5eeff285d54630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:59:47Z,use_quota=True,user_id='afb002ff016744c688c800a47eabc918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:59:49 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Creating volume 0b11c675-a87a-41a0-b07c-7f6d35d46d0b {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:59:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:59:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:59:49 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:59:49 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:59:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:59:49 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:59:49 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:59:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0b11c675-a87a-41a0-b07c-7f6d35d46d0b 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:49 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0b11c675-a87a-41a0-b07c-7f6d35d46d0b 1073741824 Apr 25 15:59:49 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:49 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b4a4a35-7b7a-4dc6-b77c-240a69080e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99aabab5-d94d-4770-b358-aa0c47af8c42', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:49 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbfc2895-f0d6-4a31-96b2-1a293fead441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:49 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Volume volume-99aabab5-d94d-4770-b358-aa0c47af8c42 (99aabab5-d94d-4770-b358-aa0c47af8c42): created successfully Apr 25 15:59:49 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbfc2895-f0d6-4a31-96b2-1a293fead441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:49 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Flow 'volume_create_manager' (efedb97e-364b-4a6f-867b-f6efb6adec59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:59:49 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-0665b480-be17-4be9-bd89-684745f78714 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Created volume successfully. Apr 25 15:59:50 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0b11c675-a87a-41a0-b07c-7f6d35d46d0b 1073741824" returned: 0 in 0.604s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0b11c675-a87a-41a0-b07c-7f6d35d46d0b {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:50 devstack sudo[90568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0b11c675-a87a-41a0-b07c-7f6d35d46d0b Apr 25 15:59:50 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:51 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0b11c675-a87a-41a0-b07c-7f6d35d46d0b" returned: 0 in 0.446s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:51 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:59:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:59:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.420s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:59:51 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T13:59:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1097448004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c63234f2-95cc-461e-a50b-12d0cbdd7d1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c72a7f0366c4f08ab5eeff285d54630',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T13:59:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T13:59:47Z,use_quota=True,user_id='afb002ff016744c688c800a47eabc918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 15:59:51 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Creating volume c63234f2-95cc-461e-a50b-12d0cbdd7d1e {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 15:59:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:59:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:59:51 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:59:51 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:59:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:59:51 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 15:59:51 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 15:59:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c63234f2-95cc-461e-a50b-12d0cbdd7d1e 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:51 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6579f9bf-410b-4e8b-8c73-ae51fea1d86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b11c675-a87a-41a0-b07c-7f6d35d46d0b', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:51 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aadd248e-8ee1-4d15-8865-05d1134da1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:51 devstack sudo[90571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c63234f2-95cc-461e-a50b-12d0cbdd7d1e 1073741824 Apr 25 15:59:51 devstack sudo[90571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:51 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Volume volume-0b11c675-a87a-41a0-b07c-7f6d35d46d0b (0b11c675-a87a-41a0-b07c-7f6d35d46d0b): created successfully Apr 25 15:59:51 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aadd248e-8ee1-4d15-8865-05d1134da1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:51 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Flow 'volume_create_manager' (8b59649d-366a-450e-b823-a8368ec7ca36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:59:51 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-3c543c00-ac07-4cb1-93fc-33d3a710320a tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Created volume successfully. Apr 25 15:59:51 devstack sudo[90571]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c63234f2-95cc-461e-a50b-12d0cbdd7d1e 1073741824" returned: 0 in 0.594s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c63234f2-95cc-461e-a50b-12d0cbdd7d1e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:51 devstack sudo[90583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c63234f2-95cc-461e-a50b-12d0cbdd7d1e Apr 25 15:59:51 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:52 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c63234f2-95cc-461e-a50b-12d0cbdd7d1e" returned: 0 in 0.454s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:52 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] <== create_volume: return (1086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 15:59:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:59:52 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4797242d-4182-4e12-b645-f3067512c6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c63234f2-95cc-461e-a50b-12d0cbdd7d1e', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:52 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f017f9-8461-42fa-98c5-33cc04ec7812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 15:59:52 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Volume volume-c63234f2-95cc-461e-a50b-12d0cbdd7d1e (c63234f2-95cc-461e-a50b-12d0cbdd7d1e): created successfully Apr 25 15:59:52 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58f017f9-8461-42fa-98c5-33cc04ec7812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 15:59:52 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Flow 'volume_create_manager' (c8c21208-5763-44ab-b00a-15cb915dd470) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 15:59:52 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-2c5ccd8d-7939-454f-8901-fa0ccba57f45 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Created volume successfully. Apr 25 15:59:53 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-516384e0-661a-4383-b645-05c1c750d8c1 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Acquiring lock "cinder-c63234f2-95cc-461e-a50b-12d0cbdd7d1e-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:59:53 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-516384e0-661a-4383-b645-05c1c750d8c1 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "cinder-c63234f2-95cc-461e-a50b-12d0cbdd7d1e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:59:53 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-516384e0-661a-4383-b645-05c1c750d8c1 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Acquiring lock "cinder-quobyte-c63234f2-95cc-461e-a50b-12d0cbdd7d1e" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:59:53 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-516384e0-661a-4383-b645-05c1c750d8c1 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "cinder-quobyte-c63234f2-95cc-461e-a50b-12d0cbdd7d1e" acquired by "delete_volume" :: waited 0.013s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:59:53 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c162de-e989-4a04-8ca2-c23639917c0f]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:59:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-516384e0-661a-4383-b645-05c1c750d8c1 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c63234f2-95cc-461e-a50b-12d0cbdd7d1e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:53 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c63234f2-95cc-461e-a50b-12d0cbdd7d1e Apr 25 15:59:53 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:53 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-516384e0-661a-4383-b645-05c1c750d8c1 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c63234f2-95cc-461e-a50b-12d0cbdd7d1e" returned: 0 in 0.520s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-516384e0-661a-4383-b645-05c1c750d8c1 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c63234f2-95cc-461e-a50b-12d0cbdd7d1e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:53 devstack sudo[90591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c63234f2-95cc-461e-a50b-12d0cbdd7d1e Apr 25 15:59:53 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:54 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-516384e0-661a-4383-b645-05c1c750d8c1 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c63234f2-95cc-461e-a50b-12d0cbdd7d1e" returned: 0 in 0.412s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:54 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-516384e0-661a-4383-b645-05c1c750d8c1 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "cinder-quobyte-c63234f2-95cc-461e-a50b-12d0cbdd7d1e" released by "delete_volume" :: held 0.971s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:59:54 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-516384e0-661a-4383-b645-05c1c750d8c1 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Created reservations ['1416dc6f-faa8-4513-b8f2-fa3417f918b4', '8bcc329a-3039-4cdf-800d-cc34976ccbeb', 'de8d0654-031f-4d38-89bf-6b237c58e945', '16b2964f-8f71-4ac9-ade9-ed37875383f5'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:59:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-516384e0-661a-4383-b645-05c1c750d8c1 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:59:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-516384e0-661a-4383-b645-05c1c750d8c1 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:59:54 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-516384e0-661a-4383-b645-05c1c750d8c1 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:59:54 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-516384e0-661a-4383-b645-05c1c750d8c1 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:59:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-516384e0-661a-4383-b645-05c1c750d8c1 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:59:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-516384e0-661a-4383-b645-05c1c750d8c1 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:54 devstack sudo[90594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:59:54 devstack sudo[90594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:54 devstack sudo[90594]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-516384e0-661a-4383-b645-05c1c750d8c1 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.434s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:54 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-516384e0-661a-4383-b645-05c1c750d8c1 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:59:54 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-516384e0-661a-4383-b645-05c1c750d8c1 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Deleted volume successfully. Apr 25 15:59:54 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-516384e0-661a-4383-b645-05c1c750d8c1 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "cinder-c63234f2-95cc-461e-a50b-12d0cbdd7d1e-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:59:55 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-8d101c84-f894-4272-bd60-584ddbc47126 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Acquiring lock "cinder-0b11c675-a87a-41a0-b07c-7f6d35d46d0b-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:59:55 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-8d101c84-f894-4272-bd60-584ddbc47126 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "cinder-0b11c675-a87a-41a0-b07c-7f6d35d46d0b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:59:55 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-8d101c84-f894-4272-bd60-584ddbc47126 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Acquiring lock "cinder-quobyte-0b11c675-a87a-41a0-b07c-7f6d35d46d0b" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:59:55 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-8d101c84-f894-4272-bd60-584ddbc47126 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "cinder-quobyte-0b11c675-a87a-41a0-b07c-7f6d35d46d0b" acquired by "delete_volume" :: waited 0.015s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:59:55 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[db910310-218d-443f-bc70-b90862337136]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:59:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8d101c84-f894-4272-bd60-584ddbc47126 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0b11c675-a87a-41a0-b07c-7f6d35d46d0b {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:55 devstack sudo[90597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0b11c675-a87a-41a0-b07c-7f6d35d46d0b Apr 25 15:59:55 devstack sudo[90597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:55 devstack sudo[90597]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8d101c84-f894-4272-bd60-584ddbc47126 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0b11c675-a87a-41a0-b07c-7f6d35d46d0b" returned: 0 in 0.516s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8d101c84-f894-4272-bd60-584ddbc47126 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0b11c675-a87a-41a0-b07c-7f6d35d46d0b {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:55 devstack sudo[90602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0b11c675-a87a-41a0-b07c-7f6d35d46d0b Apr 25 15:59:55 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:56 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8d101c84-f894-4272-bd60-584ddbc47126 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0b11c675-a87a-41a0-b07c-7f6d35d46d0b" returned: 0 in 0.428s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:56 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-8d101c84-f894-4272-bd60-584ddbc47126 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "cinder-quobyte-0b11c675-a87a-41a0-b07c-7f6d35d46d0b" released by "delete_volume" :: held 0.991s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:59:56 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-8d101c84-f894-4272-bd60-584ddbc47126 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Created reservations ['0ed77028-439b-46e0-b454-894060b4d74a', 'd9f64596-31ab-4a83-a3ce-94a4cd457a49', '08918e65-3e1d-4998-9f09-954bdd101fdb', '030f14bf-29a6-494f-a3d6-d4a227e65293'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:59:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-8d101c84-f894-4272-bd60-584ddbc47126 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:59:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-8d101c84-f894-4272-bd60-584ddbc47126 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:59:56 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-8d101c84-f894-4272-bd60-584ddbc47126 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:59:56 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-8d101c84-f894-4272-bd60-584ddbc47126 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:59:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-8d101c84-f894-4272-bd60-584ddbc47126 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:59:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8d101c84-f894-4272-bd60-584ddbc47126 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:56 devstack sudo[90605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:59:56 devstack sudo[90605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:56 devstack sudo[90605]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8d101c84-f894-4272-bd60-584ddbc47126 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.426s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:56 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-8d101c84-f894-4272-bd60-584ddbc47126 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:59:56 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-8d101c84-f894-4272-bd60-584ddbc47126 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Deleted volume successfully. Apr 25 15:59:56 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-8d101c84-f894-4272-bd60-584ddbc47126 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "cinder-0b11c675-a87a-41a0-b07c-7f6d35d46d0b-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:59:57 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b0c38d9a-1326-47ee-816d-b2f8f14d789f tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Acquiring lock "cinder-99aabab5-d94d-4770-b358-aa0c47af8c42-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:59:57 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b0c38d9a-1326-47ee-816d-b2f8f14d789f tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "cinder-99aabab5-d94d-4770-b358-aa0c47af8c42-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:59:57 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b0c38d9a-1326-47ee-816d-b2f8f14d789f tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Acquiring lock "cinder-quobyte-99aabab5-d94d-4770-b358-aa0c47af8c42" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:59:57 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b0c38d9a-1326-47ee-816d-b2f8f14d789f tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "cinder-quobyte-99aabab5-d94d-4770-b358-aa0c47af8c42" acquired by "delete_volume" :: waited 0.019s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:59:57 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[1baddc90-0dd8-4e7c-b1eb-b82e7afa943e]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:59:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b0c38d9a-1326-47ee-816d-b2f8f14d789f tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99aabab5-d94d-4770-b358-aa0c47af8c42 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:57 devstack sudo[90608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99aabab5-d94d-4770-b358-aa0c47af8c42 Apr 25 15:59:57 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:58 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b0c38d9a-1326-47ee-816d-b2f8f14d789f tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99aabab5-d94d-4770-b358-aa0c47af8c42" returned: 0 in 0.504s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b0c38d9a-1326-47ee-816d-b2f8f14d789f tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99aabab5-d94d-4770-b358-aa0c47af8c42 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:58 devstack sudo[90613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99aabab5-d94d-4770-b358-aa0c47af8c42 Apr 25 15:59:58 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:58 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b0c38d9a-1326-47ee-816d-b2f8f14d789f tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-99aabab5-d94d-4770-b358-aa0c47af8c42" returned: 0 in 0.413s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:58 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b0c38d9a-1326-47ee-816d-b2f8f14d789f tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "cinder-quobyte-99aabab5-d94d-4770-b358-aa0c47af8c42" released by "delete_volume" :: held 0.955s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:59:58 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-b0c38d9a-1326-47ee-816d-b2f8f14d789f tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Created reservations ['a33e4397-121e-4f99-8dd6-00a1f4f8e320', '6ad8bb58-41ec-4fa5-8d14-b521c3a8704a', '92418b9d-e25c-413d-8d31-e07b0f2e8cf6', 'bbb9c0d8-ec27-428d-bf97-e23e0c0be812'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:59:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b0c38d9a-1326-47ee-816d-b2f8f14d789f tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:59:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b0c38d9a-1326-47ee-816d-b2f8f14d789f tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:59:58 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b0c38d9a-1326-47ee-816d-b2f8f14d789f tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:59:58 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b0c38d9a-1326-47ee-816d-b2f8f14d789f tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:59:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b0c38d9a-1326-47ee-816d-b2f8f14d789f tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:59:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b0c38d9a-1326-47ee-816d-b2f8f14d789f tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:58 devstack sudo[90616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:59:58 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:58 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f3dee34c-5558-45e0-8f5f-9a50d35b57c4 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Acquiring lock "cinder-5e81b308-b45c-4ab9-a8fd-d21da9adf9c2-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:59:58 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f3dee34c-5558-45e0-8f5f-9a50d35b57c4 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "cinder-5e81b308-b45c-4ab9-a8fd-d21da9adf9c2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:59:58 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f3dee34c-5558-45e0-8f5f-9a50d35b57c4 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Acquiring lock "cinder-quobyte-5e81b308-b45c-4ab9-a8fd-d21da9adf9c2" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 15:59:58 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f3dee34c-5558-45e0-8f5f-9a50d35b57c4 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "cinder-quobyte-5e81b308-b45c-4ab9-a8fd-d21da9adf9c2" acquired by "delete_volume" :: waited 0.012s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 15:59:58 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc96d98-b903-4ac1-8cdb-73fc05ba24fc]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 15:59:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f3dee34c-5558-45e0-8f5f-9a50d35b57c4 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5e81b308-b45c-4ab9-a8fd-d21da9adf9c2 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:58 devstack sudo[90618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5e81b308-b45c-4ab9-a8fd-d21da9adf9c2 Apr 25 15:59:58 devstack sudo[90618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:59 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b0c38d9a-1326-47ee-816d-b2f8f14d789f tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.469s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:59 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-b0c38d9a-1326-47ee-816d-b2f8f14d789f tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 15:59:59 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-b0c38d9a-1326-47ee-816d-b2f8f14d789f tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Deleted volume successfully. Apr 25 15:59:59 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b0c38d9a-1326-47ee-816d-b2f8f14d789f tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "cinder-99aabab5-d94d-4770-b358-aa0c47af8c42-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:59:59 devstack sudo[90618]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f3dee34c-5558-45e0-8f5f-9a50d35b57c4 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5e81b308-b45c-4ab9-a8fd-d21da9adf9c2" returned: 0 in 0.507s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f3dee34c-5558-45e0-8f5f-9a50d35b57c4 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5e81b308-b45c-4ab9-a8fd-d21da9adf9c2 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:59 devstack sudo[90624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5e81b308-b45c-4ab9-a8fd-d21da9adf9c2 Apr 25 15:59:59 devstack sudo[90624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 15:59:59 devstack sudo[90624]: pam_unix(sudo:session): session closed for user root Apr 25 15:59:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f3dee34c-5558-45e0-8f5f-9a50d35b57c4 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5e81b308-b45c-4ab9-a8fd-d21da9adf9c2" returned: 0 in 0.444s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 15:59:59 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f3dee34c-5558-45e0-8f5f-9a50d35b57c4 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "cinder-quobyte-5e81b308-b45c-4ab9-a8fd-d21da9adf9c2" released by "delete_volume" :: held 0.988s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 15:59:59 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-f3dee34c-5558-45e0-8f5f-9a50d35b57c4 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Created reservations ['6aba94af-9e64-4632-99b8-0f4390202a0c', '762ed8b1-f8fe-4c38-81dc-9b9fa2963271', '256bac93-3244-4ae4-aab1-83e44da4dab7', '4aff992f-a5af-4564-a8aa-01a9423688f1'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 15:59:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f3dee34c-5558-45e0-8f5f-9a50d35b57c4 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 15:59:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f3dee34c-5558-45e0-8f5f-9a50d35b57c4 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 15:59:59 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f3dee34c-5558-45e0-8f5f-9a50d35b57c4 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 15:59:59 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f3dee34c-5558-45e0-8f5f-9a50d35b57c4 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 15:59:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f3dee34c-5558-45e0-8f5f-9a50d35b57c4 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 15:59:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f3dee34c-5558-45e0-8f5f-9a50d35b57c4 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 15:59:59 devstack sudo[90627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 15:59:59 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:00 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f3dee34c-5558-45e0-8f5f-9a50d35b57c4 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.431s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:00 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-f3dee34c-5558-45e0-8f5f-9a50d35b57c4 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 16:00:00 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-f3dee34c-5558-45e0-8f5f-9a50d35b57c4 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Deleted volume successfully. Apr 25 16:00:00 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f3dee34c-5558-45e0-8f5f-9a50d35b57c4 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "cinder-5e81b308-b45c-4ab9-a8fd-d21da9adf9c2-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:00 devstack cinder-volume[81828]: DEBUG oslo_service.periodic_task [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81828) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 25 16:00:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:00:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:00:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:00 devstack sudo[90630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 16:00:00 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:00 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.417s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:00 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 16:00:00 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-05db1916-1ee3-4441-baf8-7f3e5e3db56e tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Acquiring lock "cinder-ed39fae7-1885-4697-a896-3375449f2e2e-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:00 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-05db1916-1ee3-4441-baf8-7f3e5e3db56e tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "cinder-ed39fae7-1885-4697-a896-3375449f2e2e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:00 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-05db1916-1ee3-4441-baf8-7f3e5e3db56e tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Acquiring lock "cinder-quobyte-ed39fae7-1885-4697-a896-3375449f2e2e" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:00 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-05db1916-1ee3-4441-baf8-7f3e5e3db56e tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "cinder-quobyte-ed39fae7-1885-4697-a896-3375449f2e2e" acquired by "delete_volume" :: waited 0.015s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:00 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f86d081-1717-42e5-b82b-a304d207d68b]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:00:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-05db1916-1ee3-4441-baf8-7f3e5e3db56e tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ed39fae7-1885-4697-a896-3375449f2e2e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:01 devstack sudo[90633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ed39fae7-1885-4697-a896-3375449f2e2e Apr 25 16:00:01 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:01 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-05db1916-1ee3-4441-baf8-7f3e5e3db56e tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ed39fae7-1885-4697-a896-3375449f2e2e" returned: 0 in 0.533s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-05db1916-1ee3-4441-baf8-7f3e5e3db56e tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ed39fae7-1885-4697-a896-3375449f2e2e {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:01 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ed39fae7-1885-4697-a896-3375449f2e2e Apr 25 16:00:01 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:01 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-05db1916-1ee3-4441-baf8-7f3e5e3db56e tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-ed39fae7-1885-4697-a896-3375449f2e2e" returned: 0 in 0.434s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:01 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-05db1916-1ee3-4441-baf8-7f3e5e3db56e tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "cinder-quobyte-ed39fae7-1885-4697-a896-3375449f2e2e" released by "delete_volume" :: held 1.009s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:01 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-05db1916-1ee3-4441-baf8-7f3e5e3db56e tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Created reservations ['bd5033f1-e0ba-4622-a236-1adc46f52556', '0c3835a3-b9fe-4ed6-ba2d-e5d2a9e41c14', '397c39f9-fb2e-49df-8d1f-7e8e5330eaa1', 'abd74893-9261-42b0-813f-1046b75f93a3'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 16:00:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-05db1916-1ee3-4441-baf8-7f3e5e3db56e tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-05db1916-1ee3-4441-baf8-7f3e5e3db56e tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:02 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-05db1916-1ee3-4441-baf8-7f3e5e3db56e tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:00:02 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-05db1916-1ee3-4441-baf8-7f3e5e3db56e tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:00:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-05db1916-1ee3-4441-baf8-7f3e5e3db56e tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-05db1916-1ee3-4441-baf8-7f3e5e3db56e tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:02 devstack sudo[90642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 16:00:02 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:02 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-05db1916-1ee3-4441-baf8-7f3e5e3db56e tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.427s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:02 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-05db1916-1ee3-4441-baf8-7f3e5e3db56e tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 16:00:02 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-05db1916-1ee3-4441-baf8-7f3e5e3db56e tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Deleted volume successfully. Apr 25 16:00:02 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-05db1916-1ee3-4441-baf8-7f3e5e3db56e tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "cinder-ed39fae7-1885-4697-a896-3375449f2e2e-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:03 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-4627c991-a953-440e-a9f7-ebee8046a2c3 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Acquiring lock "cinder-8cebca84-74cd-4055-a925-6f0409e091fb-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:03 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-4627c991-a953-440e-a9f7-ebee8046a2c3 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "cinder-8cebca84-74cd-4055-a925-6f0409e091fb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:03 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-4627c991-a953-440e-a9f7-ebee8046a2c3 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Acquiring lock "cinder-quobyte-8cebca84-74cd-4055-a925-6f0409e091fb" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:03 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-4627c991-a953-440e-a9f7-ebee8046a2c3 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "cinder-quobyte-8cebca84-74cd-4055-a925-6f0409e091fb" acquired by "delete_volume" :: waited 0.018s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:03 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b43d9e-dd49-4ddb-9c97-975e93916c09]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:00:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4627c991-a953-440e-a9f7-ebee8046a2c3 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8cebca84-74cd-4055-a925-6f0409e091fb {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:03 devstack sudo[90645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8cebca84-74cd-4055-a925-6f0409e091fb Apr 25 16:00:03 devstack sudo[90645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:03 devstack sudo[90645]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4627c991-a953-440e-a9f7-ebee8046a2c3 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8cebca84-74cd-4055-a925-6f0409e091fb" returned: 0 in 0.499s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4627c991-a953-440e-a9f7-ebee8046a2c3 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8cebca84-74cd-4055-a925-6f0409e091fb {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:03 devstack sudo[90650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8cebca84-74cd-4055-a925-6f0409e091fb Apr 25 16:00:03 devstack sudo[90650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:04 devstack sudo[90650]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4627c991-a953-440e-a9f7-ebee8046a2c3 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8cebca84-74cd-4055-a925-6f0409e091fb" returned: 0 in 0.419s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:04 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-4627c991-a953-440e-a9f7-ebee8046a2c3 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "cinder-quobyte-8cebca84-74cd-4055-a925-6f0409e091fb" released by "delete_volume" :: held 0.957s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:04 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-4627c991-a953-440e-a9f7-ebee8046a2c3 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Created reservations ['cb1cc9b4-04d8-4e89-97e1-a87280576726', 'd0128f30-5260-47e8-bc65-3f407b0821fd', '4e332480-7c96-43b7-ae76-7d7a352d46bb', 'aace018c-41d5-4272-a5b8-6001bb0d5b2b'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 16:00:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4627c991-a953-440e-a9f7-ebee8046a2c3 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4627c991-a953-440e-a9f7-ebee8046a2c3 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:04 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4627c991-a953-440e-a9f7-ebee8046a2c3 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:00:04 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4627c991-a953-440e-a9f7-ebee8046a2c3 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:00:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4627c991-a953-440e-a9f7-ebee8046a2c3 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4627c991-a953-440e-a9f7-ebee8046a2c3 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:04 devstack sudo[90653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 16:00:04 devstack sudo[90653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:04 devstack sudo[90653]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4627c991-a953-440e-a9f7-ebee8046a2c3 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.489s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:04 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-4627c991-a953-440e-a9f7-ebee8046a2c3 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 16:00:04 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-4627c991-a953-440e-a9f7-ebee8046a2c3 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Deleted volume successfully. Apr 25 16:00:04 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-4627c991-a953-440e-a9f7-ebee8046a2c3 tempest-CreateVolumesFromSourceVolumeTest-1411698382 None] Lock "cinder-8cebca84-74cd-4055-a925-6f0409e091fb-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] Flow 'volume_create_manager' (a9d447aa-db23-4eef-a239-2d27824feacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ff66c8-dfd7-4c9b-921a-84e7e9905cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ff66c8-dfd7-4c9b-921a-84e7e9905cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-459477861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcf34d91-e3be-4166-87fe-3e0a3bb4d59a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c41e483c77a44fb7b9c182a2c5bc80b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:13Z,use_quota=True,user_id='29c5156637c04e1c9b82bceaa1b5fcf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63b42ba1-13cb-4e7d-a029-ea9076234fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63b42ba1-13cb-4e7d-a029-ea9076234fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2197097-8772-4cd4-a002-96e469420009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2197097-8772-4cd4-a002-96e469420009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcf34d91-e3be-4166-87fe-3e0a3bb4d59a', 'volume_name': 'volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ce55447-57dc-412e-9835-8d319e7f640b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ce55447-57dc-412e-9835-8d319e7f640b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee06ce0d-4f28-4408-93c4-f1f25458458b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:12 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] Volume bcf34d91-e3be-4166-87fe-3e0a3bb4d59a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a', 'volume_size': 1} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-459477861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcf34d91-e3be-4166-87fe-3e0a3bb4d59a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c41e483c77a44fb7b9c182a2c5bc80b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:13Z,use_quota=True,user_id='29c5156637c04e1c9b82bceaa1b5fcf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] Creating volume bcf34d91-e3be-4166-87fe-3e0a3bb4d59a {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 16:00:12 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 16:00:12 devstack sudo[90699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a 1073741824 Apr 25 16:00:12 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] Flow 'volume_create_manager' (08625d4d-25d0-45bc-b4b7-31bbf4658b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec35334-5aa7-485c-82c1-656b5496716e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec35334-5aa7-485c-82c1-656b5496716e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2065590665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81b299f6-b05a-4c7e-9b91-b4ab7cc21901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbfcded218554bb6afc32d8c14700f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:13Z,use_quota=True,user_id='025cf4a214cb4678bf7564822ef685d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e4f0de3-40f6-4b27-865d-75a708378e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e4f0de3-40f6-4b27-865d-75a708378e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21eabb4-ccdd-4763-a00d-6ceeeb5ac52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21eabb4-ccdd-4763-a00d-6ceeeb5ac52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81b299f6-b05a-4c7e-9b91-b4ab7cc21901', 'volume_name': 'volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1abdf686-3b53-45c8-a827-da08ee07b3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1abdf686-3b53-45c8-a827-da08ee07b3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c6a0baa-4c75-49d6-9327-9d7476cd8ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:12 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] Volume 81b299f6-b05a-4c7e-9b91-b4ab7cc21901: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901', 'volume_size': 1} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] Flow 'volume_create_manager' (d86838b2-6483-4adb-812b-2802d775709a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3773dc5-41cc-42cd-ad23-b32cd42a05eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:12 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3773dc5-41cc-42cd-ad23-b32cd42a05eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-592853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0007f50-6a5f-4ec3-b458-67e0cf35d9fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e862522969bf4cf98588f9b6f33ee76c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:13Z,use_quota=True,user_id='65205da4146c42b9877d7c73f89c61b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c169783-1d2d-45f1-b670-ef99e7701391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c169783-1d2d-45f1-b670-ef99e7701391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b82e63ae-82e8-475e-bb0e-afb1b3c0cf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b82e63ae-82e8-475e-bb0e-afb1b3c0cf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0007f50-6a5f-4ec3-b458-67e0cf35d9fb', 'volume_name': 'volume-a0007f50-6a5f-4ec3-b458-67e0cf35d9fb', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea072ec8-9954-4375-9e66-5d0b533dfa37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea072ec8-9954-4375-9e66-5d0b533dfa37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cc4a852-8757-4c7f-a576-dabbc76d98f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:13 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] Volume a0007f50-6a5f-4ec3-b458-67e0cf35d9fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0007f50-6a5f-4ec3-b458-67e0cf35d9fb', 'volume_size': 1} Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] Flow 'volume_create_manager' (0835ce77-60ee-4de8-ba43-f1e4536bbb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (453fa54e-4fca-45cb-8967-93d6966adee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (453fa54e-4fca-45cb-8967-93d6966adee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-267784230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f45c2849-e94b-454c-a968-3afccab4b0c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e862522969bf4cf98588f9b6f33ee76c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:13Z,use_quota=True,user_id='65205da4146c42b9877d7c73f89c61b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a841e3bf-e208-4635-89b9-43ff3fb34986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a841e3bf-e208-4635-89b9-43ff3fb34986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7436bf50-a631-4b38-a7dd-92b6f1496edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7436bf50-a631-4b38-a7dd-92b6f1496edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f45c2849-e94b-454c-a968-3afccab4b0c7', 'volume_name': 'volume-f45c2849-e94b-454c-a968-3afccab4b0c7', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3238193-24fd-4809-a0cb-d0c9da6a7b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3238193-24fd-4809-a0cb-d0c9da6a7b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84091a9-39cd-46d2-b898-d55cdc2bbc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:13 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] Volume f45c2849-e94b-454c-a968-3afccab4b0c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f45c2849-e94b-454c-a968-3afccab4b0c7', 'volume_size': 1} Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:13 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a 1073741824" returned: 0 in 0.999s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:13 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a Apr 25 16:00:13 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] Flow 'volume_create_manager' (090a32ae-3c7f-4229-a5fa-c2dc910252d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e55daa9e-92f1-41f3-94b9-c31fc75cf5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e55daa9e-92f1-41f3-94b9-c31fc75cf5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2805268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edbb8c2b-7b24-4a9b-aa46-c5fbe5bfc76f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e862522969bf4cf98588f9b6f33ee76c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:14Z,use_quota=True,user_id='65205da4146c42b9877d7c73f89c61b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e3c783a-69ee-4eca-88bd-8e09a8819547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e3c783a-69ee-4eca-88bd-8e09a8819547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0504c59b-e71d-4604-8559-5e66a3853788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0504c59b-e71d-4604-8559-5e66a3853788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edbb8c2b-7b24-4a9b-aa46-c5fbe5bfc76f', 'volume_name': 'volume-edbb8c2b-7b24-4a9b-aa46-c5fbe5bfc76f', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39807c00-d1c6-4d3c-adda-e32213814c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39807c00-d1c6-4d3c-adda-e32213814c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd85780-1628-44db-a864-fae98b6189a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:13 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] Volume edbb8c2b-7b24-4a9b-aa46-c5fbe5bfc76f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edbb8c2b-7b24-4a9b-aa46-c5fbe5bfc76f', 'volume_size': 1} Apr 25 16:00:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] Flow 'volume_create_manager' (fb28b2b5-65f2-46bf-91d1-e0b3d434e325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (492af2fe-82e3-43e4-a56d-0976c28cc486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (492af2fe-82e3-43e4-a56d-0976c28cc486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-713752352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c19f2e61-0960-4423-bad1-a773cda7b121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e862522969bf4cf98588f9b6f33ee76c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:14Z,use_quota=True,user_id='65205da4146c42b9877d7c73f89c61b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01196f78-35fb-4a62-9220-de1d75f203de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01196f78-35fb-4a62-9220-de1d75f203de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e79e907-3c60-476f-a7a7-67cc5ba70015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e79e907-3c60-476f-a7a7-67cc5ba70015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c19f2e61-0960-4423-bad1-a773cda7b121', 'volume_name': 'volume-c19f2e61-0960-4423-bad1-a773cda7b121', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (372d4cf4-e3a8-4fc2-9039-c98411c96cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (372d4cf4-e3a8-4fc2-9039-c98411c96cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (569a57d2-29fc-4769-a536-7c61b27124f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:14 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] Volume c19f2e61-0960-4423-bad1-a773cda7b121: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c19f2e61-0960-4423-bad1-a773cda7b121', 'volume_size': 1} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] Flow 'volume_create_manager' (be1d4dad-714d-4d74-ae7d-5f43096585f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d217b70-d1b7-477c-8adf-878a1379eb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:14 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d217b70-d1b7-477c-8adf-878a1379eb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1230800251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4f9b6f1-e8d6-4b5b-b699-f97ab2ba26a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e862522969bf4cf98588f9b6f33ee76c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:14Z,use_quota=True,user_id='65205da4146c42b9877d7c73f89c61b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7993824-b904-4e17-8fa0-9728025b5d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7993824-b904-4e17-8fa0-9728025b5d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eced7dd4-ab4b-43f5-9cb6-732b2b9bd742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eced7dd4-ab4b-43f5-9cb6-732b2b9bd742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4f9b6f1-e8d6-4b5b-b699-f97ab2ba26a9', 'volume_name': 'volume-f4f9b6f1-e8d6-4b5b-b699-f97ab2ba26a9', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e66a38f-bb19-458b-9597-433442cdb629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e66a38f-bb19-458b-9597-433442cdb629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2bf2e77-9f31-46d9-a7c9-a1d3793b9395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:14 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] Volume f4f9b6f1-e8d6-4b5b-b699-f97ab2ba26a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4f9b6f1-e8d6-4b5b-b699-f97ab2ba26a9', 'volume_size': 1} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a" returned: 0 in 0.639s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.552s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2065590665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81b299f6-b05a-4c7e-9b91-b4ab7cc21901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbfcded218554bb6afc32d8c14700f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:13Z,use_quota=True,user_id='025cf4a214cb4678bf7564822ef685d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] Creating volume 81b299f6-b05a-4c7e-9b91-b4ab7cc21901 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 16:00:14 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee06ce0d-4f28-4408-93c4-f1f25458458b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa04c7f2-9b1d-442c-b35e-aec6f5fe2bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:14 devstack sudo[90741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901 1073741824 Apr 25 16:00:14 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:14 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] Volume volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a (bcf34d91-e3be-4166-87fe-3e0a3bb4d59a): created successfully Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa04c7f2-9b1d-442c-b35e-aec6f5fe2bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] Flow 'volume_create_manager' (a9d447aa-db23-4eef-a239-2d27824feacd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:14 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-85d5b8ff-a3f0-4b8f-aea1-a3a484736611 tempest-VolumeDependencyTests-1097684438 None] Created volume successfully. Apr 25 16:00:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d61aa50f-b51a-45e1-9c81-03ce0e809b63 tempest-VolumeDependencyTests-1097684438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:15 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901 1073741824" returned: 0 in 0.707s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:15 devstack sudo[90746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901 Apr 25 16:00:15 devstack sudo[90746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:15 devstack sudo[90746]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901" returned: 0 in 0.499s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 16:00:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.638s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-592853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0007f50-6a5f-4ec3-b458-67e0cf35d9fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e862522969bf4cf98588f9b6f33ee76c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:13Z,use_quota=True,user_id='65205da4146c42b9877d7c73f89c61b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 16:00:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] Creating volume a0007f50-6a5f-4ec3-b458-67e0cf35d9fb {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 16:00:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:00:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:00:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 16:00:15 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 16:00:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a0007f50-6a5f-4ec3-b458-67e0cf35d9fb 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:15 devstack sudo[90749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a0007f50-6a5f-4ec3-b458-67e0cf35d9fb 1073741824 Apr 25 16:00:15 devstack sudo[90749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c6a0baa-4c75-49d6-9327-9d7476cd8ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55cfd567-0c44-424b-9cfa-f2ec36bd6442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:15 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] Volume volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901 (81b299f6-b05a-4c7e-9b91-b4ab7cc21901): created successfully Apr 25 16:00:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55cfd567-0c44-424b-9cfa-f2ec36bd6442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:15 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] Flow 'volume_create_manager' (08625d4d-25d0-45bc-b4b7-31bbf4658b2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:15 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-ca41afa7-5cb0-4883-a053-ef9c3e7dad02 tempest-CreateVolumesFromSnapshotTest-289507390 None] Created volume successfully. Apr 25 16:00:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f5c67267-eb34-4dd6-a5f4-674b2d6937da tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:16 devstack sudo[90749]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a0007f50-6a5f-4ec3-b458-67e0cf35d9fb 1073741824" returned: 0 in 0.658s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a0007f50-6a5f-4ec3-b458-67e0cf35d9fb {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:16 devstack sudo[90754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a0007f50-6a5f-4ec3-b458-67e0cf35d9fb Apr 25 16:00:16 devstack sudo[90754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:16 devstack sudo[90754]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a0007f50-6a5f-4ec3-b458-67e0cf35d9fb" returned: 0 in 0.475s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 16:00:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.215s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-267784230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f45c2849-e94b-454c-a968-3afccab4b0c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e862522969bf4cf98588f9b6f33ee76c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:13Z,use_quota=True,user_id='65205da4146c42b9877d7c73f89c61b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 16:00:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] Creating volume f45c2849-e94b-454c-a968-3afccab4b0c7 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 16:00:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:00:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:00:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:16 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 16:00:16 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 16:00:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f45c2849-e94b-454c-a968-3afccab4b0c7 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cc4a852-8757-4c7f-a576-dabbc76d98f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0007f50-6a5f-4ec3-b458-67e0cf35d9fb', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:16 devstack sudo[90757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f45c2849-e94b-454c-a968-3afccab4b0c7 1073741824 Apr 25 16:00:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07eaa979-9a41-49b3-ac01-e7f9c92ee307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:16 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:16 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] Volume volume-a0007f50-6a5f-4ec3-b458-67e0cf35d9fb (a0007f50-6a5f-4ec3-b458-67e0cf35d9fb): created successfully Apr 25 16:00:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07eaa979-9a41-49b3-ac01-e7f9c92ee307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:16 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] Flow 'volume_create_manager' (d86838b2-6483-4adb-812b-2802d775709a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:16 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-6a02d17b-cf6b-4296-a0d7-91681ff43c68 tempest-CreateVolumesFromImageTest-871125090 None] Created volume successfully. Apr 25 16:00:17 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f45c2849-e94b-454c-a968-3afccab4b0c7 1073741824" returned: 0 in 0.814s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f45c2849-e94b-454c-a968-3afccab4b0c7 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:17 devstack sudo[90762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f45c2849-e94b-454c-a968-3afccab4b0c7 Apr 25 16:00:17 devstack sudo[90762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:18 devstack sudo[90762]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f45c2849-e94b-454c-a968-3afccab4b0c7" returned: 0 in 0.510s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:18 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] <== create_volume: return (1378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 16:00:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.382s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.296s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:18 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2805268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edbb8c2b-7b24-4a9b-aa46-c5fbe5bfc76f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e862522969bf4cf98588f9b6f33ee76c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:14Z,use_quota=True,user_id='65205da4146c42b9877d7c73f89c61b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 16:00:18 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] Creating volume edbb8c2b-7b24-4a9b-aa46-c5fbe5bfc76f {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 16:00:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:18 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:00:18 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:00:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:18 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 16:00:18 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 16:00:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-edbb8c2b-7b24-4a9b-aa46-c5fbe5bfc76f 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:18 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c84091a9-39cd-46d2-b898-d55cdc2bbc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f45c2849-e94b-454c-a968-3afccab4b0c7', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:18 devstack sudo[90765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-edbb8c2b-7b24-4a9b-aa46-c5fbe5bfc76f 1073741824 Apr 25 16:00:18 devstack sudo[90765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:18 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4458d6ba-aa78-4fe3-b81e-2bab5eeb6be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:18 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] Volume volume-f45c2849-e94b-454c-a968-3afccab4b0c7 (f45c2849-e94b-454c-a968-3afccab4b0c7): created successfully Apr 25 16:00:18 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4458d6ba-aa78-4fe3-b81e-2bab5eeb6be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:18 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] Flow 'volume_create_manager' (0835ce77-60ee-4de8-ba43-f1e4536bbb62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:18 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-c2787682-9c2c-4489-82ab-696e51d46bbd tempest-CreateVolumesFromImageTest-871125090 None] Created volume successfully. Apr 25 16:00:18 devstack sudo[90765]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-edbb8c2b-7b24-4a9b-aa46-c5fbe5bfc76f 1073741824" returned: 0 in 0.638s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-edbb8c2b-7b24-4a9b-aa46-c5fbe5bfc76f {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:18 devstack sudo[90770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-edbb8c2b-7b24-4a9b-aa46-c5fbe5bfc76f Apr 25 16:00:18 devstack sudo[90770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:19 devstack sudo[90770]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-edbb8c2b-7b24-4a9b-aa46-c5fbe5bfc76f" returned: 0 in 0.515s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 16:00:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.251s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-713752352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c19f2e61-0960-4423-bad1-a773cda7b121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e862522969bf4cf98588f9b6f33ee76c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:14Z,use_quota=True,user_id='65205da4146c42b9877d7c73f89c61b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 16:00:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] Creating volume c19f2e61-0960-4423-bad1-a773cda7b121 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 16:00:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:00:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:00:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 16:00:19 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 16:00:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c19f2e61-0960-4423-bad1-a773cda7b121 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd85780-1628-44db-a864-fae98b6189a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edbb8c2b-7b24-4a9b-aa46-c5fbe5bfc76f', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:19 devstack sudo[90773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c19f2e61-0960-4423-bad1-a773cda7b121 1073741824 Apr 25 16:00:19 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (343cae78-047a-413a-b4ed-a40377eebd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:19 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] Volume volume-edbb8c2b-7b24-4a9b-aa46-c5fbe5bfc76f (edbb8c2b-7b24-4a9b-aa46-c5fbe5bfc76f): created successfully Apr 25 16:00:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (343cae78-047a-413a-b4ed-a40377eebd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] Flow 'volume_create_manager' (090a32ae-3c7f-4229-a5fa-c2dc910252d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:19 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-0af97eed-e97c-45f3-9f8a-499c8a00d01f tempest-CreateVolumesFromImageTest-871125090 None] Created volume successfully. Apr 25 16:00:20 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c19f2e61-0960-4423-bad1-a773cda7b121 1073741824" returned: 0 in 0.696s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c19f2e61-0960-4423-bad1-a773cda7b121 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:20 devstack sudo[90778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c19f2e61-0960-4423-bad1-a773cda7b121 Apr 25 16:00:20 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:20 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c19f2e61-0960-4423-bad1-a773cda7b121" returned: 0 in 0.452s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:20 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 16:00:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.248s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:20 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1230800251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4f9b6f1-e8d6-4b5b-b699-f97ab2ba26a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e862522969bf4cf98588f9b6f33ee76c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:14Z,use_quota=True,user_id='65205da4146c42b9877d7c73f89c61b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 16:00:20 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] Creating volume f4f9b6f1-e8d6-4b5b-b699-f97ab2ba26a9 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 16:00:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:20 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:00:20 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:00:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:20 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 16:00:20 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 16:00:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f4f9b6f1-e8d6-4b5b-b699-f97ab2ba26a9 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:20 devstack sudo[90781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f4f9b6f1-e8d6-4b5b-b699-f97ab2ba26a9 1073741824 Apr 25 16:00:20 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (569a57d2-29fc-4769-a536-7c61b27124f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c19f2e61-0960-4423-bad1-a773cda7b121', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5242bb9b-c41a-4711-a727-befeaa1ac165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:20 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] Volume volume-c19f2e61-0960-4423-bad1-a773cda7b121 (c19f2e61-0960-4423-bad1-a773cda7b121): created successfully Apr 25 16:00:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5242bb9b-c41a-4711-a727-befeaa1ac165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] Flow 'volume_create_manager' (fb28b2b5-65f2-46bf-91d1-e0b3d434e325) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:20 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-c05db5bf-0250-486d-a690-3e6f39ecbd67 tempest-CreateVolumesFromImageTest-871125090 None] Created volume successfully. Apr 25 16:00:21 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f4f9b6f1-e8d6-4b5b-b699-f97ab2ba26a9 1073741824" returned: 0 in 0.626s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f4f9b6f1-e8d6-4b5b-b699-f97ab2ba26a9 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:21 devstack sudo[90786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f4f9b6f1-e8d6-4b5b-b699-f97ab2ba26a9 Apr 25 16:00:21 devstack sudo[90786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:21 devstack sudo[90786]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f4f9b6f1-e8d6-4b5b-b699-f97ab2ba26a9" returned: 0 in 0.467s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:21 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 16:00:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d61aa50f-b51a-45e1-9c81-03ce0e809b63 tempest-VolumeDependencyTests-1097684438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.875s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:21 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2bf2e77-9f31-46d9-a7c9-a1d3793b9395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4f9b6f1-e8d6-4b5b-b699-f97ab2ba26a9', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:21 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e2d011a-5113-402f-89cf-94ec421d6618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:21 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-d61aa50f-b51a-45e1-9c81-03ce0e809b63 tempest-VolumeDependencyTests-1097684438 None] Creating offline snapshot 6ee1f20f-2517-4c26-a86a-0445e30a1d85 of volume bcf34d91-e3be-4166-87fe-3e0a3bb4d59a {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 16:00:21 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] Volume volume-f4f9b6f1-e8d6-4b5b-b699-f97ab2ba26a9 (f4f9b6f1-e8d6-4b5b-b699-f97ab2ba26a9): created successfully Apr 25 16:00:21 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e2d011a-5113-402f-89cf-94ec421d6618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:21 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] Flow 'volume_create_manager' (be1d4dad-714d-4d74-ae7d-5f43096585f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:21 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[e884786e-b2cc-4834-bd0f-caeda317acdb]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:00:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d61aa50f-b51a-45e1-9c81-03ce0e809b63 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:21 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-2119ad27-a34e-4dd5-96eb-265af7ebc95d tempest-CreateVolumesFromImageTest-871125090 None] Created volume successfully. Apr 25 16:00:21 devstack sudo[90790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a Apr 25 16:00:21 devstack sudo[90790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:22 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7957d59c-c2f5-4a5b-907d-4728c4720243 tempest-CreateVolumesFromImageTest-871125090 None] Acquiring lock "cinder-f4f9b6f1-e8d6-4b5b-b699-f97ab2ba26a9-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:22 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7957d59c-c2f5-4a5b-907d-4728c4720243 tempest-CreateVolumesFromImageTest-871125090 None] Lock "cinder-f4f9b6f1-e8d6-4b5b-b699-f97ab2ba26a9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:22 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7957d59c-c2f5-4a5b-907d-4728c4720243 tempest-CreateVolumesFromImageTest-871125090 None] Acquiring lock "cinder-quobyte-f4f9b6f1-e8d6-4b5b-b699-f97ab2ba26a9" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:22 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7957d59c-c2f5-4a5b-907d-4728c4720243 tempest-CreateVolumesFromImageTest-871125090 None] Lock "cinder-quobyte-f4f9b6f1-e8d6-4b5b-b699-f97ab2ba26a9" acquired by "delete_volume" :: waited 0.019s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:22 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cad655-e5b9-4a76-87b7-640414ab5d8c]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:00:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7957d59c-c2f5-4a5b-907d-4728c4720243 tempest-CreateVolumesFromImageTest-871125090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f4f9b6f1-e8d6-4b5b-b699-f97ab2ba26a9 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:22 devstack sudo[90792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f4f9b6f1-e8d6-4b5b-b699-f97ab2ba26a9 Apr 25 16:00:22 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:22 devstack sudo[90790]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d61aa50f-b51a-45e1-9c81-03ce0e809b63 tempest-VolumeDependencyTests-1097684438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a" returned: 0 in 0.605s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d61aa50f-b51a-45e1-9c81-03ce0e809b63 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a.6ee1f20f-2517-4c26-a86a-0445e30a1d85 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:22 devstack sudo[90797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a.6ee1f20f-2517-4c26-a86a-0445e30a1d85 1G Apr 25 16:00:22 devstack sudo[90797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:22 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7957d59c-c2f5-4a5b-907d-4728c4720243 tempest-CreateVolumesFromImageTest-871125090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f4f9b6f1-e8d6-4b5b-b699-f97ab2ba26a9" returned: 0 in 0.681s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7957d59c-c2f5-4a5b-907d-4728c4720243 tempest-CreateVolumesFromImageTest-871125090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f4f9b6f1-e8d6-4b5b-b699-f97ab2ba26a9 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:22 devstack sudo[90802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f4f9b6f1-e8d6-4b5b-b699-f97ab2ba26a9 Apr 25 16:00:22 devstack sudo[90802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:23 devstack sudo[90797]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d61aa50f-b51a-45e1-9c81-03ce0e809b63 tempest-VolumeDependencyTests-1097684438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a.6ee1f20f-2517-4c26-a86a-0445e30a1d85 1G" returned: 0 in 0.713s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d61aa50f-b51a-45e1-9c81-03ce0e809b63 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a.6ee1f20f-2517-4c26-a86a-0445e30a1d85 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:23 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a.6ee1f20f-2517-4c26-a86a-0445e30a1d85 Apr 25 16:00:23 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:23 devstack sudo[90802]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7957d59c-c2f5-4a5b-907d-4728c4720243 tempest-CreateVolumesFromImageTest-871125090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f4f9b6f1-e8d6-4b5b-b699-f97ab2ba26a9" returned: 0 in 0.577s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:23 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7957d59c-c2f5-4a5b-907d-4728c4720243 tempest-CreateVolumesFromImageTest-871125090 None] Lock "cinder-quobyte-f4f9b6f1-e8d6-4b5b-b699-f97ab2ba26a9" released by "delete_volume" :: held 1.310s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:23 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-7957d59c-c2f5-4a5b-907d-4728c4720243 tempest-CreateVolumesFromImageTest-871125090 None] Created reservations ['e4442e9d-1933-4a7a-940f-fb94be19f014', 'aef14dae-a61b-40a0-8bd0-7d86297fa8ec', '51a3b997-da7a-4b65-8d76-0a78b1d0f3b6', 'a44198eb-a084-47c1-a45a-2a85a80b2944'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 16:00:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7957d59c-c2f5-4a5b-907d-4728c4720243 tempest-CreateVolumesFromImageTest-871125090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7957d59c-c2f5-4a5b-907d-4728c4720243 tempest-CreateVolumesFromImageTest-871125090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:23 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-7957d59c-c2f5-4a5b-907d-4728c4720243 tempest-CreateVolumesFromImageTest-871125090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:00:23 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-7957d59c-c2f5-4a5b-907d-4728c4720243 tempest-CreateVolumesFromImageTest-871125090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:00:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7957d59c-c2f5-4a5b-907d-4728c4720243 tempest-CreateVolumesFromImageTest-871125090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7957d59c-c2f5-4a5b-907d-4728c4720243 tempest-CreateVolumesFromImageTest-871125090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:23 devstack sudo[90810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 16:00:23 devstack sudo[90810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:23 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d61aa50f-b51a-45e1-9c81-03ce0e809b63 tempest-VolumeDependencyTests-1097684438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a.6ee1f20f-2517-4c26-a86a-0445e30a1d85" returned: 0 in 0.559s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:23 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-d61aa50f-b51a-45e1-9c81-03ce0e809b63 tempest-VolumeDependencyTests-1097684438 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a.6ee1f20f-2517-4c26-a86a-0445e30a1d85 is being set with open permissions: ugo+rw Apr 25 16:00:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d61aa50f-b51a-45e1-9c81-03ce0e809b63 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a.6ee1f20f-2517-4c26-a86a-0445e30a1d85 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:23 devstack sudo[90815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a.6ee1f20f-2517-4c26-a86a-0445e30a1d85 Apr 25 16:00:23 devstack sudo[90815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:24 devstack sudo[90810]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7957d59c-c2f5-4a5b-907d-4728c4720243 tempest-CreateVolumesFromImageTest-871125090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.531s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:24 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-7957d59c-c2f5-4a5b-907d-4728c4720243 tempest-CreateVolumesFromImageTest-871125090 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 16:00:24 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-7957d59c-c2f5-4a5b-907d-4728c4720243 tempest-CreateVolumesFromImageTest-871125090 None] Deleted volume successfully. Apr 25 16:00:24 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7957d59c-c2f5-4a5b-907d-4728c4720243 tempest-CreateVolumesFromImageTest-871125090 None] Lock "cinder-f4f9b6f1-e8d6-4b5b-b699-f97ab2ba26a9-delete_volume" released by "delete_volume" :: held 2.066s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:24 devstack sudo[90815]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:24 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e1116ece-0d73-42a5-9db7-61fb666107a5 tempest-CreateVolumesFromImageTest-871125090 None] Acquiring lock "cinder-c19f2e61-0960-4423-bad1-a773cda7b121-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d61aa50f-b51a-45e1-9c81-03ce0e809b63 tempest-VolumeDependencyTests-1097684438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a.6ee1f20f-2517-4c26-a86a-0445e30a1d85" returned: 0 in 0.551s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:24 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e1116ece-0d73-42a5-9db7-61fb666107a5 tempest-CreateVolumesFromImageTest-871125090 None] Lock "cinder-c19f2e61-0960-4423-bad1-a773cda7b121-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:24 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e1116ece-0d73-42a5-9db7-61fb666107a5 tempest-CreateVolumesFromImageTest-871125090 None] Acquiring lock "cinder-quobyte-c19f2e61-0960-4423-bad1-a773cda7b121" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d61aa50f-b51a-45e1-9c81-03ce0e809b63 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:24 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e1116ece-0d73-42a5-9db7-61fb666107a5 tempest-CreateVolumesFromImageTest-871125090 None] Lock "cinder-quobyte-c19f2e61-0960-4423-bad1-a773cda7b121" acquired by "delete_volume" :: waited 0.043s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:24 devstack sudo[90821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a.info Apr 25 16:00:24 devstack sudo[90821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:24 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[c135a5a9-8585-4ad0-9692-4c04ff01af4f]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:00:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e1116ece-0d73-42a5-9db7-61fb666107a5 tempest-CreateVolumesFromImageTest-871125090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c19f2e61-0960-4423-bad1-a773cda7b121 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:24 devstack sudo[90823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c19f2e61-0960-4423-bad1-a773cda7b121 Apr 25 16:00:24 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:24 devstack sudo[90821]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d61aa50f-b51a-45e1-9c81-03ce0e809b63 tempest-VolumeDependencyTests-1097684438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a.info" returned: 0 in 0.572s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:24 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-d61aa50f-b51a-45e1-9c81-03ce0e809b63 tempest-VolumeDependencyTests-1097684438 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a.info is being set with open permissions: ugo+rw Apr 25 16:00:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d61aa50f-b51a-45e1-9c81-03ce0e809b63 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:25 devstack sudo[90827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a.info Apr 25 16:00:25 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:25 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e1116ece-0d73-42a5-9db7-61fb666107a5 tempest-CreateVolumesFromImageTest-871125090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c19f2e61-0960-4423-bad1-a773cda7b121" returned: 0 in 0.624s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e1116ece-0d73-42a5-9db7-61fb666107a5 tempest-CreateVolumesFromImageTest-871125090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c19f2e61-0960-4423-bad1-a773cda7b121 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:25 devstack sudo[90831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c19f2e61-0960-4423-bad1-a773cda7b121 Apr 25 16:00:25 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:25 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d61aa50f-b51a-45e1-9c81-03ce0e809b63 tempest-VolumeDependencyTests-1097684438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a.info" returned: 0 in 0.472s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d61aa50f-b51a-45e1-9c81-03ce0e809b63 tempest-VolumeDependencyTests-1097684438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.658s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f5c67267-eb34-4dd6-a5f4-674b2d6937da tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.386s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:25 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-f5c67267-eb34-4dd6-a5f4-674b2d6937da tempest-CreateVolumesFromSnapshotTest-289507390 None] Creating offline snapshot 5fd16a0f-16bb-4ce5-b48b-aba9549fc148 of volume 81b299f6-b05a-4c7e-9b91-b4ab7cc21901 {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 16:00:25 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5964175-9469-493d-b7bc-3fe8e9158bba]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:00:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f5c67267-eb34-4dd6-a5f4-674b2d6937da tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:25 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-d61aa50f-b51a-45e1-9c81-03ce0e809b63 tempest-VolumeDependencyTests-1097684438 None] Create snapshot completed successfully Apr 25 16:00:25 devstack sudo[90834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901 Apr 25 16:00:25 devstack sudo[90834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:25 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e1116ece-0d73-42a5-9db7-61fb666107a5 tempest-CreateVolumesFromImageTest-871125090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c19f2e61-0960-4423-bad1-a773cda7b121" returned: 0 in 0.572s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:25 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e1116ece-0d73-42a5-9db7-61fb666107a5 tempest-CreateVolumesFromImageTest-871125090 None] Lock "cinder-quobyte-c19f2e61-0960-4423-bad1-a773cda7b121" released by "delete_volume" :: held 1.261s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:25 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-e1116ece-0d73-42a5-9db7-61fb666107a5 tempest-CreateVolumesFromImageTest-871125090 None] Created reservations ['c4c1f77b-a194-483f-a3c4-caf11097ad9b', 'f771eb0e-2b4d-407e-be94-bba929068b1c', '48052290-c4fe-4763-a9c3-69cbb3143367', '9f0f25f5-7895-4d9f-b4b0-25a9c11c0d9b'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 16:00:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e1116ece-0d73-42a5-9db7-61fb666107a5 tempest-CreateVolumesFromImageTest-871125090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e1116ece-0d73-42a5-9db7-61fb666107a5 tempest-CreateVolumesFromImageTest-871125090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:25 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e1116ece-0d73-42a5-9db7-61fb666107a5 tempest-CreateVolumesFromImageTest-871125090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:00:25 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-e1116ece-0d73-42a5-9db7-61fb666107a5 tempest-CreateVolumesFromImageTest-871125090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:00:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-e1116ece-0d73-42a5-9db7-61fb666107a5 tempest-CreateVolumesFromImageTest-871125090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e1116ece-0d73-42a5-9db7-61fb666107a5 tempest-CreateVolumesFromImageTest-871125090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:25 devstack sudo[90837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 16:00:25 devstack sudo[90837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:26 devstack sudo[90834]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f5c67267-eb34-4dd6-a5f4-674b2d6937da tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901" returned: 0 in 0.590s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f5c67267-eb34-4dd6-a5f4-674b2d6937da tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901.5fd16a0f-16bb-4ce5-b48b-aba9549fc148 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:26 devstack sudo[90842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901.5fd16a0f-16bb-4ce5-b48b-aba9549fc148 1G Apr 25 16:00:26 devstack sudo[90842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:26 devstack sudo[90837]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-e1116ece-0d73-42a5-9db7-61fb666107a5 tempest-CreateVolumesFromImageTest-871125090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.499s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:26 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-e1116ece-0d73-42a5-9db7-61fb666107a5 tempest-CreateVolumesFromImageTest-871125090 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 16:00:26 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-e1116ece-0d73-42a5-9db7-61fb666107a5 tempest-CreateVolumesFromImageTest-871125090 None] Deleted volume successfully. Apr 25 16:00:26 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-e1116ece-0d73-42a5-9db7-61fb666107a5 tempest-CreateVolumesFromImageTest-871125090 None] Lock "cinder-c19f2e61-0960-4423-bad1-a773cda7b121-delete_volume" released by "delete_volume" :: held 2.045s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:26 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ac97a098-79bd-4542-a781-ba7d5f76b626 tempest-CreateVolumesFromImageTest-871125090 None] Acquiring lock "cinder-edbb8c2b-7b24-4a9b-aa46-c5fbe5bfc76f-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:26 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ac97a098-79bd-4542-a781-ba7d5f76b626 tempest-CreateVolumesFromImageTest-871125090 None] Lock "cinder-edbb8c2b-7b24-4a9b-aa46-c5fbe5bfc76f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:26 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ac97a098-79bd-4542-a781-ba7d5f76b626 tempest-CreateVolumesFromImageTest-871125090 None] Acquiring lock "cinder-quobyte-edbb8c2b-7b24-4a9b-aa46-c5fbe5bfc76f" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:26 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ac97a098-79bd-4542-a781-ba7d5f76b626 tempest-CreateVolumesFromImageTest-871125090 None] Lock "cinder-quobyte-edbb8c2b-7b24-4a9b-aa46-c5fbe5bfc76f" acquired by "delete_volume" :: waited 0.031s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:26 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b6e0e6-dd38-49d4-8e13-3554f80aaed5]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:00:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ac97a098-79bd-4542-a781-ba7d5f76b626 tempest-CreateVolumesFromImageTest-871125090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-edbb8c2b-7b24-4a9b-aa46-c5fbe5bfc76f {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:26 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 16:00:26 devstack sudo[90848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-edbb8c2b-7b24-4a9b-aa46-c5fbe5bfc76f Apr 25 16:00:26 devstack sudo[90848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Flow 'volume_create_manager' (b2169812-0028-4315-850d-a60b35cc0861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a2de198-a5b8-4dd2-beac-23154b34c8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a2de198-a5b8-4dd2-beac-23154b34c8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-795469733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b63c6eb-1ba0-4438-bfb0-9974a4cdb625,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c41e483c77a44fb7b9c182a2c5bc80b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6ee1f20f-2517-4c26-a86a-0445e30a1d85,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:27Z,use_quota=True,user_id='29c5156637c04e1c9b82bceaa1b5fcf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65db8a8a-c242-4431-bb81-1e80c4c037ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65db8a8a-c242-4431-bb81-1e80c4c037ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc0b2af6-a7b0-454d-b191-9379a5c159c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc0b2af6-a7b0-454d-b191-9379a5c159c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7b63c6eb-1ba0-4438-bfb0-9974a4cdb625', 'volume_name': 'volume-7b63c6eb-1ba0-4438-bfb0-9974a4cdb625', 'volume_size': 1, 'snapshot_id': '6ee1f20f-2517-4c26-a86a-0445e30a1d85'}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (364ae324-bf8e-46f4-bca5-daf8d67b9a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (364ae324-bf8e-46f4-bca5-daf8d67b9a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:26 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b158ec09-bfd7-4e01-9453-c46f73db4831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:26 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Volume 7b63c6eb-1ba0-4438-bfb0-9974a4cdb625: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7b63c6eb-1ba0-4438-bfb0-9974a4cdb625', 'volume_size': 1, 'snapshot_id': '6ee1f20f-2517-4c26-a86a-0445e30a1d85'} Apr 25 16:00:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:26 devstack sudo[90842]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f5c67267-eb34-4dd6-a5f4-674b2d6937da tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901.5fd16a0f-16bb-4ce5-b48b-aba9549fc148 1G" returned: 0 in 0.806s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f5c67267-eb34-4dd6-a5f4-674b2d6937da tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901.5fd16a0f-16bb-4ce5-b48b-aba9549fc148 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:26 devstack sudo[90850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901.5fd16a0f-16bb-4ce5-b48b-aba9549fc148 Apr 25 16:00:26 devstack sudo[90850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:27 devstack sudo[90848]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ac97a098-79bd-4542-a781-ba7d5f76b626 tempest-CreateVolumesFromImageTest-871125090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-edbb8c2b-7b24-4a9b-aa46-c5fbe5bfc76f" returned: 0 in 0.591s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ac97a098-79bd-4542-a781-ba7d5f76b626 tempest-CreateVolumesFromImageTest-871125090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-edbb8c2b-7b24-4a9b-aa46-c5fbe5bfc76f {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:27 devstack sudo[90857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-edbb8c2b-7b24-4a9b-aa46-c5fbe5bfc76f Apr 25 16:00:27 devstack sudo[90857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:27 devstack sudo[90850]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f5c67267-eb34-4dd6-a5f4-674b2d6937da tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901.5fd16a0f-16bb-4ce5-b48b-aba9549fc148" returned: 0 in 0.541s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:27 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-f5c67267-eb34-4dd6-a5f4-674b2d6937da tempest-CreateVolumesFromSnapshotTest-289507390 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901.5fd16a0f-16bb-4ce5-b48b-aba9549fc148 is being set with open permissions: ugo+rw Apr 25 16:00:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f5c67267-eb34-4dd6-a5f4-674b2d6937da tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901.5fd16a0f-16bb-4ce5-b48b-aba9549fc148 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:27 devstack sudo[90860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901.5fd16a0f-16bb-4ce5-b48b-aba9549fc148 Apr 25 16:00:27 devstack sudo[90860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:27 devstack sudo[90857]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ac97a098-79bd-4542-a781-ba7d5f76b626 tempest-CreateVolumesFromImageTest-871125090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-edbb8c2b-7b24-4a9b-aa46-c5fbe5bfc76f" returned: 0 in 0.529s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:27 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ac97a098-79bd-4542-a781-ba7d5f76b626 tempest-CreateVolumesFromImageTest-871125090 None] Lock "cinder-quobyte-edbb8c2b-7b24-4a9b-aa46-c5fbe5bfc76f" released by "delete_volume" :: held 1.163s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:27 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-ac97a098-79bd-4542-a781-ba7d5f76b626 tempest-CreateVolumesFromImageTest-871125090 None] Created reservations ['d95d867a-fabd-455d-b778-25f053872ad6', '1ae40aee-b859-45d2-8898-1ab20e1dc632', '496bbfc5-33b4-4553-9e51-4a8ca36a1ae4', '5fc9b6ba-bd26-45a8-af1d-f29acbe56e93'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 16:00:27 devstack sudo[90860]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f5c67267-eb34-4dd6-a5f4-674b2d6937da tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901.5fd16a0f-16bb-4ce5-b48b-aba9549fc148" returned: 0 in 0.497s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ac97a098-79bd-4542-a781-ba7d5f76b626 tempest-CreateVolumesFromImageTest-871125090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ac97a098-79bd-4542-a781-ba7d5f76b626 tempest-CreateVolumesFromImageTest-871125090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:27 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-ac97a098-79bd-4542-a781-ba7d5f76b626 tempest-CreateVolumesFromImageTest-871125090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:00:27 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-ac97a098-79bd-4542-a781-ba7d5f76b626 tempest-CreateVolumesFromImageTest-871125090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:00:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ac97a098-79bd-4542-a781-ba7d5f76b626 tempest-CreateVolumesFromImageTest-871125090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ac97a098-79bd-4542-a781-ba7d5f76b626 tempest-CreateVolumesFromImageTest-871125090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:28 devstack sudo[90864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 16:00:28 devstack sudo[90864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f5c67267-eb34-4dd6-a5f4-674b2d6937da tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:28 devstack sudo[90866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901.info Apr 25 16:00:28 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:28 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f5c67267-eb34-4dd6-a5f4-674b2d6937da tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901.info" returned: 0 in 0.597s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:28 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-f5c67267-eb34-4dd6-a5f4-674b2d6937da tempest-CreateVolumesFromSnapshotTest-289507390 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901.info is being set with open permissions: ugo+rw Apr 25 16:00:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f5c67267-eb34-4dd6-a5f4-674b2d6937da tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:28 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901.info Apr 25 16:00:28 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:28 devstack sudo[90864]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ac97a098-79bd-4542-a781-ba7d5f76b626 tempest-CreateVolumesFromImageTest-871125090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.710s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:28 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-ac97a098-79bd-4542-a781-ba7d5f76b626 tempest-CreateVolumesFromImageTest-871125090 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 16:00:28 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-ac97a098-79bd-4542-a781-ba7d5f76b626 tempest-CreateVolumesFromImageTest-871125090 None] Deleted volume successfully. Apr 25 16:00:28 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ac97a098-79bd-4542-a781-ba7d5f76b626 tempest-CreateVolumesFromImageTest-871125090 None] Lock "cinder-edbb8c2b-7b24-4a9b-aa46-c5fbe5bfc76f-delete_volume" released by "delete_volume" :: held 2.150s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:28 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7563134c-10d2-4164-905c-3af02013d76d tempest-CreateVolumesFromImageTest-871125090 None] Acquiring lock "cinder-f45c2849-e94b-454c-a968-3afccab4b0c7-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:28 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7563134c-10d2-4164-905c-3af02013d76d tempest-CreateVolumesFromImageTest-871125090 None] Lock "cinder-f45c2849-e94b-454c-a968-3afccab4b0c7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:28 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7563134c-10d2-4164-905c-3af02013d76d tempest-CreateVolumesFromImageTest-871125090 None] Acquiring lock "cinder-quobyte-f45c2849-e94b-454c-a968-3afccab4b0c7" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:28 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7563134c-10d2-4164-905c-3af02013d76d tempest-CreateVolumesFromImageTest-871125090 None] Lock "cinder-quobyte-f45c2849-e94b-454c-a968-3afccab4b0c7" acquired by "delete_volume" :: waited 0.021s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:29 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89dfed9-54cf-40fe-a89b-0cbfe0f8dc2d]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:00:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7563134c-10d2-4164-905c-3af02013d76d tempest-CreateVolumesFromImageTest-871125090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f45c2849-e94b-454c-a968-3afccab4b0c7 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:29 devstack sudo[90872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f45c2849-e94b-454c-a968-3afccab4b0c7 Apr 25 16:00:29 devstack sudo[90872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:29 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f5c67267-eb34-4dd6-a5f4-674b2d6937da tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901.info" returned: 0 in 0.533s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f5c67267-eb34-4dd6-a5f4-674b2d6937da tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.729s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.296s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:29 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Acquiring lock "cinder-quobyte-6ee1f20f-2517-4c26-a86a-0445e30a1d85-7b63c6eb-1ba0-4438-bfb0-9974a4cdb625" by "_create_volume_from_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:29 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Lock "cinder-quobyte-6ee1f20f-2517-4c26-a86a-0445e30a1d85-7b63c6eb-1ba0-4438-bfb0-9974a4cdb625" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:29 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Creating volume 7b63c6eb-1ba0-4438-bfb0-9974a4cdb625 from snapshot 6ee1f20f-2517-4c26-a86a-0445e30a1d85 {{(pid=81828) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 25 16:00:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:29 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:00:29 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:00:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:29 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 16:00:29 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Acquiring lock "cinder-quobyte-7b63c6eb-1ba0-4438-bfb0-9974a4cdb625" by "_copy_volume_from_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:29 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-f5c67267-eb34-4dd6-a5f4-674b2d6937da tempest-CreateVolumesFromSnapshotTest-289507390 None] Create snapshot completed successfully Apr 25 16:00:29 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Lock "cinder-quobyte-7b63c6eb-1ba0-4438-bfb0-9974a4cdb625" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:29 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] snapshot: 6ee1f20f-2517-4c26-a86a-0445e30a1d85, volume: 7b63c6eb-1ba0-4438-bfb0-9974a4cdb625, {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 25 16:00:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:29 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:00:29 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:00:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:29 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e60780-8824-4203-960b-81a294201f60]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:00:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a.6ee1f20f-2517-4c26-a86a-0445e30a1d85 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:29 devstack sudo[90875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a.6ee1f20f-2517-4c26-a86a-0445e30a1d85 Apr 25 16:00:29 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:29 devstack sudo[90872]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7563134c-10d2-4164-905c-3af02013d76d tempest-CreateVolumesFromImageTest-871125090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f45c2849-e94b-454c-a968-3afccab4b0c7" returned: 0 in 0.605s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7563134c-10d2-4164-905c-3af02013d76d tempest-CreateVolumesFromImageTest-871125090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f45c2849-e94b-454c-a968-3afccab4b0c7 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:29 devstack sudo[90880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f45c2849-e94b-454c-a968-3afccab4b0c7 Apr 25 16:00:29 devstack sudo[90880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] Flow 'volume_create_manager' (7a622e9f-0571-4cf4-8afd-0df81b7b3983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8abbb1ad-1ddf-4030-b232-b9aef5ea2924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8abbb1ad-1ddf-4030-b232-b9aef5ea2924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-919857411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9dc45a6-13bd-46f9-89a8-be480f8cb024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbfcded218554bb6afc32d8c14700f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:30Z,use_quota=True,user_id='025cf4a214cb4678bf7564822ef685d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4055a1d0-b33c-4f17-8489-f3e89474de5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4055a1d0-b33c-4f17-8489-f3e89474de5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8fe9372-2cb2-4f78-bef0-716731b0fe32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8fe9372-2cb2-4f78-bef0-716731b0fe32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9dc45a6-13bd-46f9-89a8-be480f8cb024', 'volume_name': 'volume-e9dc45a6-13bd-46f9-89a8-be480f8cb024', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (603e6a21-eaed-485e-b5ef-0fa5a1ac134b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (603e6a21-eaed-485e-b5ef-0fa5a1ac134b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d01c1c-df19-4f03-9aed-d168652aba28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:30 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] Volume e9dc45a6-13bd-46f9-89a8-be480f8cb024: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9dc45a6-13bd-46f9-89a8-be480f8cb024', 'volume_size': 1} Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:30 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a.6ee1f20f-2517-4c26-a86a-0445e30a1d85" returned: 0 in 0.899s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] will copy from snapshot at /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Creating direct copy from snapshot {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedbcfc7-3b5f-4e87-90e7-24a5757b94ea]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 16:00:30 devstack sudo[90885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a Apr 25 16:00:30 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] Flow 'volume_create_manager' (fdcc4ae7-3db6-46b9-8c84-320581f9216b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01ae559b-b5b5-473f-86f8-bab26bba58b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01ae559b-b5b5-473f-86f8-bab26bba58b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-486146405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c09b95-5702-4499-b5e6-b52fad56de67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbfcded218554bb6afc32d8c14700f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:30Z,use_quota=True,user_id='025cf4a214cb4678bf7564822ef685d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd4141db-1e53-4c8c-862e-ae776c123c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd4141db-1e53-4c8c-862e-ae776c123c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb088f45-0226-4d3a-9670-f75d880c1fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb088f45-0226-4d3a-9670-f75d880c1fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42c09b95-5702-4499-b5e6-b52fad56de67', 'volume_name': 'volume-42c09b95-5702-4499-b5e6-b52fad56de67', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (516cdae1-7e9e-4cc4-9f57-57024ce569cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (516cdae1-7e9e-4cc4-9f57-57024ce569cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7170023-8fa1-41e7-92f0-212ed809cfc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:30 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] Volume 42c09b95-5702-4499-b5e6-b52fad56de67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42c09b95-5702-4499-b5e6-b52fad56de67', 'volume_size': 1} Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:30 devstack sudo[90880]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7563134c-10d2-4164-905c-3af02013d76d tempest-CreateVolumesFromImageTest-871125090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f45c2849-e94b-454c-a968-3afccab4b0c7" returned: 0 in 1.252s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7563134c-10d2-4164-905c-3af02013d76d tempest-CreateVolumesFromImageTest-871125090 None] Lock "cinder-quobyte-f45c2849-e94b-454c-a968-3afccab4b0c7" released by "delete_volume" :: held 1.922s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] Flow 'volume_create_manager' (dc184acc-4c92-4287-9a3d-bedf1aa6b2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:30 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e27a78-663d-4253-9fc5-9a4a1ffad657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e27a78-663d-4253-9fc5-9a4a1ffad657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1004034303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a37f5af9-c1cb-430f-aa7f-3edeeb7cd525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbfcded218554bb6afc32d8c14700f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:31Z,use_quota=True,user_id='025cf4a214cb4678bf7564822ef685d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8e9f4be-8aec-4f7a-903e-14b910027c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8e9f4be-8aec-4f7a-903e-14b910027c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (051e7792-df97-48e0-bbc2-ca86777ee3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (051e7792-df97-48e0-bbc2-ca86777ee3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a37f5af9-c1cb-430f-aa7f-3edeeb7cd525', 'volume_name': 'volume-a37f5af9-c1cb-430f-aa7f-3edeeb7cd525', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ae4c123-b67a-4d1c-9088-7d162978a1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ae4c123-b67a-4d1c-9088-7d162978a1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b266271-67b8-467d-a57d-3319f9cf55aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:31 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] Volume a37f5af9-c1cb-430f-aa7f-3edeeb7cd525: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a37f5af9-c1cb-430f-aa7f-3edeeb7cd525', 'volume_size': 1} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-7563134c-10d2-4164-905c-3af02013d76d tempest-CreateVolumesFromImageTest-871125090 None] Created reservations ['fd486792-b6e9-4c17-92e6-c203449d0a2b', 'c4550b81-589b-4c0c-a77f-84d2f602e886', '7e687473-fdd7-4e6e-a33d-e6ba4218099c', '604b1157-9243-435d-9ce8-9feb30ed3f26'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 16:00:31 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a" returned: 0 in 0.913s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.utils [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Path /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7b63c6eb-1ba0-4438-bfb0-9974a4cdb625 not found in is_blk_device check {{(pid=81828) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7b63c6eb-1ba0-4438-bfb0-9974a4cdb625 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:31 devstack sudo[90891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7b63c6eb-1ba0-4438-bfb0-9974a4cdb625 Apr 25 16:00:31 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7563134c-10d2-4164-905c-3af02013d76d tempest-CreateVolumesFromImageTest-871125090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7563134c-10d2-4164-905c-3af02013d76d tempest-CreateVolumesFromImageTest-871125090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-7563134c-10d2-4164-905c-3af02013d76d tempest-CreateVolumesFromImageTest-871125090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-7563134c-10d2-4164-905c-3af02013d76d tempest-CreateVolumesFromImageTest-871125090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7563134c-10d2-4164-905c-3af02013d76d tempest-CreateVolumesFromImageTest-871125090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7563134c-10d2-4164-905c-3af02013d76d tempest-CreateVolumesFromImageTest-871125090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-df002282-5be6-4b3b-b372-856864d34e8e tempest-CreateVolumesFromImageTest-871125090 None] Acquiring lock "cinder-a0007f50-6a5f-4ec3-b458-67e0cf35d9fb-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:31 devstack sudo[90893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 16:00:31 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] Flow 'volume_create_manager' (4e69252b-6933-46ed-a68e-19797048bef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4da7d790-9144-4647-b859-915f032d8d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-df002282-5be6-4b3b-b372-856864d34e8e tempest-CreateVolumesFromImageTest-871125090 None] Lock "cinder-a0007f50-6a5f-4ec3-b458-67e0cf35d9fb-delete_volume" acquired by "delete_volume" :: waited 0.135s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4da7d790-9144-4647-b859-915f032d8d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-113246596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6497138-2215-4ab9-9bd1-39b1b9df29d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbfcded218554bb6afc32d8c14700f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:31Z,use_quota=True,user_id='025cf4a214cb4678bf7564822ef685d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9831fbd-869f-431a-8bb7-48e24e9c4b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9831fbd-869f-431a-8bb7-48e24e9c4b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65bb86ee-869e-4d18-b6b5-abdd67a78353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65bb86ee-869e-4d18-b6b5-abdd67a78353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6497138-2215-4ab9-9bd1-39b1b9df29d6', 'volume_name': 'volume-c6497138-2215-4ab9-9bd1-39b1b9df29d6', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (898fe547-bb89-4b85-8c9c-84ecca423ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (898fe547-bb89-4b85-8c9c-84ecca423ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae57735e-92a1-4bae-a29e-d054dc051cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:31 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] Volume c6497138-2215-4ab9-9bd1-39b1b9df29d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6497138-2215-4ab9-9bd1-39b1b9df29d6', 'volume_size': 1} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-df002282-5be6-4b3b-b372-856864d34e8e tempest-CreateVolumesFromImageTest-871125090 None] Acquiring lock "cinder-quobyte-a0007f50-6a5f-4ec3-b458-67e0cf35d9fb" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-df002282-5be6-4b3b-b372-856864d34e8e tempest-CreateVolumesFromImageTest-871125090 None] Lock "cinder-quobyte-a0007f50-6a5f-4ec3-b458-67e0cf35d9fb" acquired by "delete_volume" :: waited 0.021s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23918fa-d093-425b-aaeb-2042e762ef21]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-df002282-5be6-4b3b-b372-856864d34e8e tempest-CreateVolumesFromImageTest-871125090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a0007f50-6a5f-4ec3-b458-67e0cf35d9fb {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] Flow 'volume_create_manager' (44301683-e611-4a0b-8b46-b511a23e087a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b253389c-e063-4f84-97bb-fecb9a5183ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b253389c-e063-4f84-97bb-fecb9a5183ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-427997528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bafdc4d-16b8-42ed-b9b5-0d72ee1276f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbfcded218554bb6afc32d8c14700f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:32Z,use_quota=True,user_id='025cf4a214cb4678bf7564822ef685d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1472d7fb-a91a-4721-867c-3c8a9cb4a7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1472d7fb-a91a-4721-867c-3c8a9cb4a7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ed085e-284a-49fe-bb1a-2e3b74aa704c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97ed085e-284a-49fe-bb1a-2e3b74aa704c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bafdc4d-16b8-42ed-b9b5-0d72ee1276f4', 'volume_name': 'volume-1bafdc4d-16b8-42ed-b9b5-0d72ee1276f4', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f32519-aebe-40c7-8ae4-bb3a315c707b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f32519-aebe-40c7-8ae4-bb3a315c707b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9a2610-39b8-4b8c-afe5-c48c4132a998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:31 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] Volume 1bafdc4d-16b8-42ed-b9b5-0d72ee1276f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bafdc4d-16b8-42ed-b9b5-0d72ee1276f4', 'volume_size': 1} Apr 25 16:00:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:31 devstack sudo[90896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a0007f50-6a5f-4ec3-b458-67e0cf35d9fb Apr 25 16:00:31 devstack sudo[90896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:32 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7563134c-10d2-4164-905c-3af02013d76d tempest-CreateVolumesFromImageTest-871125090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 1.176s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:32 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-7563134c-10d2-4164-905c-3af02013d76d tempest-CreateVolumesFromImageTest-871125090 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 16:00:32 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-7563134c-10d2-4164-905c-3af02013d76d tempest-CreateVolumesFromImageTest-871125090 None] Deleted volume successfully. Apr 25 16:00:32 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7563134c-10d2-4164-905c-3af02013d76d tempest-CreateVolumesFromImageTest-871125090 None] Lock "cinder-f45c2849-e94b-454c-a968-3afccab4b0c7-delete_volume" released by "delete_volume" :: held 3.688s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:33 devstack sudo[90896]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-df002282-5be6-4b3b-b372-856864d34e8e tempest-CreateVolumesFromImageTest-871125090 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a0007f50-6a5f-4ec3-b458-67e0cf35d9fb" returned: 0 in 1.612s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-df002282-5be6-4b3b-b372-856864d34e8e tempest-CreateVolumesFromImageTest-871125090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a0007f50-6a5f-4ec3-b458-67e0cf35d9fb {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:33 devstack sudo[90916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a0007f50-6a5f-4ec3-b458-67e0cf35d9fb Apr 25 16:00:33 devstack sudo[90916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:34 devstack sudo[90916]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-df002282-5be6-4b3b-b372-856864d34e8e tempest-CreateVolumesFromImageTest-871125090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a0007f50-6a5f-4ec3-b458-67e0cf35d9fb" returned: 0 in 1.231s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:34 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-df002282-5be6-4b3b-b372-856864d34e8e tempest-CreateVolumesFromImageTest-871125090 None] Lock "cinder-quobyte-a0007f50-6a5f-4ec3-b458-67e0cf35d9fb" released by "delete_volume" :: held 2.897s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:34 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-df002282-5be6-4b3b-b372-856864d34e8e tempest-CreateVolumesFromImageTest-871125090 None] Created reservations ['90aab81f-f355-4932-af42-6388138a8289', 'cfea1723-7d68-4c23-9560-7a4878e94c8e', '5b570ea5-fa75-4071-ad2f-e805012ee17f', 'a153bce8-6e2c-4c99-977d-2f953d366f15'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 16:00:34 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 16:00:34 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] Flow 'volume_create_manager' (eb3ecf36-795f-4dbc-a0ff-6ac6c22d4da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:34 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d14c5461-c6bf-4f3c-8b3a-497acedd8911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:34 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d14c5461-c6bf-4f3c-8b3a-497acedd8911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1287447451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bdea943-0c2c-45a4-b545-4ad3ae96084a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b8aa77d0314a8f826123125062e2bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:35Z,use_quota=True,user_id='04c373dc8248493da672689dc6ebf576',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:34 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (296c4250-fbc1-42e1-beb6-2f80a503289b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:34 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (296c4250-fbc1-42e1-beb6-2f80a503289b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:34 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff76c3c4-bbd7-4ca1-9f59-8f286a19d1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:34 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff76c3c4-bbd7-4ca1-9f59-8f286a19d1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bdea943-0c2c-45a4-b545-4ad3ae96084a', 'volume_name': 'volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:34 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c95e35-0585-43e0-804b-e4e7a9d89920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:34 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c95e35-0585-43e0-804b-e4e7a9d89920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:34 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (919f8c45-ad06-49e2-bb88-b327f1984af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:34 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] Volume 5bdea943-0c2c-45a4-b545-4ad3ae96084a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a', 'volume_size': 1} Apr 25 16:00:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-df002282-5be6-4b3b-b372-856864d34e8e tempest-CreateVolumesFromImageTest-871125090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-df002282-5be6-4b3b-b372-856864d34e8e tempest-CreateVolumesFromImageTest-871125090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:34 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-df002282-5be6-4b3b-b372-856864d34e8e tempest-CreateVolumesFromImageTest-871125090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:00:34 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-df002282-5be6-4b3b-b372-856864d34e8e tempest-CreateVolumesFromImageTest-871125090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:00:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-df002282-5be6-4b3b-b372-856864d34e8e tempest-CreateVolumesFromImageTest-871125090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-df002282-5be6-4b3b-b372-856864d34e8e tempest-CreateVolumesFromImageTest-871125090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:34 devstack sudo[90919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 16:00:34 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:35 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-df002282-5be6-4b3b-b372-856864d34e8e tempest-CreateVolumesFromImageTest-871125090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 1.033s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:35 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-df002282-5be6-4b3b-b372-856864d34e8e tempest-CreateVolumesFromImageTest-871125090 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 16:00:35 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-df002282-5be6-4b3b-b372-856864d34e8e tempest-CreateVolumesFromImageTest-871125090 None] Deleted volume successfully. Apr 25 16:00:36 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-df002282-5be6-4b3b-b372-856864d34e8e tempest-CreateVolumesFromImageTest-871125090 None] Lock "cinder-a0007f50-6a5f-4ec3-b458-67e0cf35d9fb-delete_volume" released by "delete_volume" :: held 4.496s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:37 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7b63c6eb-1ba0-4438-bfb0-9974a4cdb625" returned: 0 in 6.650s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:37 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[906f55ab-ca39-42db-b979-c4ce7f103f2a]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:00:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:37 devstack sudo[90922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a Apr 25 16:00:37 devstack sudo[90922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:38 devstack sudo[90922]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a" returned: 0 in 0.690s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:38 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Image conversion details: src /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a, size 1024.00 MB, duration 6.65 sec, destination /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7b63c6eb-1ba0-4438-bfb0-9974a4cdb625 {{(pid=81828) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 16:00:38 devstack cinder-volume[81828]: INFO cinder.image.image_utils [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Converted 1024.00 MB image at 153.96 MB/s Apr 25 16:00:38 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7b63c6eb-1ba0-4438-bfb0-9974a4cdb625 is being set with open permissions: ugo+rw Apr 25 16:00:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7b63c6eb-1ba0-4438-bfb0-9974a4cdb625 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:38 devstack sudo[90927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7b63c6eb-1ba0-4438-bfb0-9974a4cdb625 Apr 25 16:00:38 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:38 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 16:00:38 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] Flow 'volume_create_manager' (de153b0b-1f80-499a-8ecd-6ca0da40c3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:38 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05015459-e739-484c-bbb0-cc240661a70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:38 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05015459-e739-484c-bbb0-cc240661a70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e576b9c6-6793-4870-a7d3-9f73a5f6d989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c3ddb2ccc7d4b4bb1130f4beb5846ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:39Z,use_quota=True,user_id='cd9e85c64dbd449a9f311dac6374312c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:38 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2da21ddf-ff4e-4b7e-b8e5-b56c977bec8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:38 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2da21ddf-ff4e-4b7e-b8e5-b56c977bec8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:38 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (086846ba-4cc1-4cfd-8fc0-7153dcc7f9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:38 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (086846ba-4cc1-4cfd-8fc0-7153dcc7f9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e576b9c6-6793-4870-a7d3-9f73a5f6d989', 'volume_name': 'volume-e576b9c6-6793-4870-a7d3-9f73a5f6d989', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:38 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d3e854-0dfb-4b28-a782-0e9b53633e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:38 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d3e854-0dfb-4b28-a782-0e9b53633e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:38 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76bdd47-665a-4b8f-bed0-092f1553dfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:38 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] Volume e576b9c6-6793-4870-a7d3-9f73a5f6d989: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e576b9c6-6793-4870-a7d3-9f73a5f6d989', 'volume_size': 1} Apr 25 16:00:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:39 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7b63c6eb-1ba0-4438-bfb0-9974a4cdb625" returned: 0 in 0.454s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:39 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Lock "cinder-quobyte-7b63c6eb-1ba0-4438-bfb0-9974a4cdb625" released by "_copy_volume_from_snapshot" :: held 9.768s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:39 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Lock "cinder-quobyte-6ee1f20f-2517-4c26-a86a-0445e30a1d85-7b63c6eb-1ba0-4438-bfb0-9974a4cdb625" released by "_create_volume_from_snapshot" :: held 9.807s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.837s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.793s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:39 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-919857411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9dc45a6-13bd-46f9-89a8-be480f8cb024,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbfcded218554bb6afc32d8c14700f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:30Z,use_quota=True,user_id='025cf4a214cb4678bf7564822ef685d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 16:00:39 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] Creating volume e9dc45a6-13bd-46f9-89a8-be480f8cb024 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 16:00:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:39 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:00:39 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:00:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:39 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 16:00:39 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 16:00:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e9dc45a6-13bd-46f9-89a8-be480f8cb024 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:39 devstack sudo[90930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e9dc45a6-13bd-46f9-89a8-be480f8cb024 1073741824 Apr 25 16:00:39 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:39 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b158ec09-bfd7-4e01-9453-c46f73db4831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b63c6eb-1ba0-4438-bfb0-9974a4cdb625', 'volume_size': 1, 'snapshot_id': '6ee1f20f-2517-4c26-a86a-0445e30a1d85'}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:39 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c61f433d-9e4b-4722-96ec-69d2394266b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:39 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Volume volume-7b63c6eb-1ba0-4438-bfb0-9974a4cdb625 (7b63c6eb-1ba0-4438-bfb0-9974a4cdb625): created successfully Apr 25 16:00:39 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c61f433d-9e4b-4722-96ec-69d2394266b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:39 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Flow 'volume_create_manager' (b2169812-0028-4315-850d-a60b35cc0861) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:39 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-3301614c-51af-4d9e-ade9-64008af20a92 tempest-VolumeDependencyTests-1097684438 None] Created volume successfully. Apr 25 16:00:39 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e9dc45a6-13bd-46f9-89a8-be480f8cb024 1073741824" returned: 0 in 0.667s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:39 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e9dc45a6-13bd-46f9-89a8-be480f8cb024 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:39 devstack sudo[90935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e9dc45a6-13bd-46f9-89a8-be480f8cb024 Apr 25 16:00:39 devstack sudo[90935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:39 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-09f577c2-0126-49f9-9299-0aa5f20c5c46 tempest-VolumeDependencyTests-1097684438 None] Acquiring lock "cinder-6ee1f20f-2517-4c26-a86a-0445e30a1d85-delete_snapshot" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-09f577c2-0126-49f9-9299-0aa5f20c5c46 tempest-VolumeDependencyTests-1097684438 None] Lock "cinder-6ee1f20f-2517-4c26-a86a-0445e30a1d85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-09f577c2-0126-49f9-9299-0aa5f20c5c46 tempest-VolumeDependencyTests-1097684438 None] Acquiring lock "cinder-quobyte-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-09f577c2-0126-49f9-9299-0aa5f20c5c46 tempest-VolumeDependencyTests-1097684438 None] Lock "cinder-quobyte-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-09f577c2-0126-49f9-9299-0aa5f20c5c46 tempest-VolumeDependencyTests-1097684438 None] Acquiring lock "cinder-quobyte-6ee1f20f-2517-4c26-a86a-0445e30a1d85" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-09f577c2-0126-49f9-9299-0aa5f20c5c46 tempest-VolumeDependencyTests-1097684438 None] Lock "cinder-quobyte-6ee1f20f-2517-4c26-a86a-0445e30a1d85" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-09f577c2-0126-49f9-9299-0aa5f20c5c46 tempest-VolumeDependencyTests-1097684438 None] Deleting offline snapshot 6ee1f20f-2517-4c26-a86a-0445e30a1d85 of volume bcf34d91-e3be-4166-87fe-3e0a3bb4d59a {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-09f577c2-0126-49f9-9299-0aa5f20c5c46 tempest-VolumeDependencyTests-1097684438 None] snapshot_file for this snap is: volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a.6ee1f20f-2517-4c26-a86a-0445e30a1d85 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa8dab0-62f5-49b3-b9e1-332ea64b81bf]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-09f577c2-0126-49f9-9299-0aa5f20c5c46 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a.6ee1f20f-2517-4c26-a86a-0445e30a1d85 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:40 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a.6ee1f20f-2517-4c26-a86a-0445e30a1d85 Apr 25 16:00:40 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:40 devstack sudo[90935]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e9dc45a6-13bd-46f9-89a8-be480f8cb024" returned: 0 in 0.474s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.642s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-486146405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c09b95-5702-4499-b5e6-b52fad56de67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbfcded218554bb6afc32d8c14700f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:30Z,use_quota=True,user_id='025cf4a214cb4678bf7564822ef685d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] Creating volume 42c09b95-5702-4499-b5e6-b52fad56de67 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 16:00:40 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-42c09b95-5702-4499-b5e6-b52fad56de67 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8d01c1c-df19-4f03-9aed-d168652aba28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9dc45a6-13bd-46f9-89a8-be480f8cb024', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643e7b77-6142-4524-bfe9-c4866c395ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:40 devstack sudo[90941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-42c09b95-5702-4499-b5e6-b52fad56de67 1073741824 Apr 25 16:00:40 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:40 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] Volume volume-e9dc45a6-13bd-46f9-89a8-be480f8cb024 (e9dc45a6-13bd-46f9-89a8-be480f8cb024): created successfully Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643e7b77-6142-4524-bfe9-c4866c395ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] Flow 'volume_create_manager' (7a622e9f-0571-4cf4-8afd-0df81b7b3983) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:40 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-b7ee48db-d24c-42e8-978b-b3a62312d132 tempest-CreateVolumesFromSnapshotTest-289507390 None] Created volume successfully. Apr 25 16:00:40 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-09f577c2-0126-49f9-9299-0aa5f20c5c46 tempest-VolumeDependencyTests-1097684438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a.6ee1f20f-2517-4c26-a86a-0445e30a1d85" returned: 0 in 0.527s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-09f577c2-0126-49f9-9299-0aa5f20c5c46 tempest-VolumeDependencyTests-1097684438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[536a0630-86f9-4ef1-b466-2ad17337d2a5]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-09f577c2-0126-49f9-9299-0aa5f20c5c46 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:40 devstack sudo[90949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a Apr 25 16:00:40 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:40 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-42c09b95-5702-4499-b5e6-b52fad56de67 1073741824" returned: 0 in 0.640s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:INSERT=32,cinder:UPDATE=125,cinder:SELECT=105,cinder:DELETE=18 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:SELECT=100,cinder:INSERT=32,cinder:UPDATE=168,cinder:DELETE=11 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 16:00:40 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-42c09b95-5702-4499-b5e6-b52fad56de67 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:40 devstack sudo[90951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-42c09b95-5702-4499-b5e6-b52fad56de67 Apr 25 16:00:40 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:41 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-09f577c2-0126-49f9-9299-0aa5f20c5c46 tempest-VolumeDependencyTests-1097684438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a" returned: 0 in 0.592s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-09f577c2-0126-49f9-9299-0aa5f20c5c46 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a.6ee1f20f-2517-4c26-a86a-0445e30a1d85 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:41 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a.6ee1f20f-2517-4c26-a86a-0445e30a1d85 Apr 25 16:00:41 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:41 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-42c09b95-5702-4499-b5e6-b52fad56de67" returned: 0 in 0.466s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:41 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 16:00:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.344s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:41 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1004034303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a37f5af9-c1cb-430f-aa7f-3edeeb7cd525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbfcded218554bb6afc32d8c14700f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:31Z,use_quota=True,user_id='025cf4a214cb4678bf7564822ef685d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 16:00:41 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] Creating volume a37f5af9-c1cb-430f-aa7f-3edeeb7cd525 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 16:00:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:41 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:00:41 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:00:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:41 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 16:00:41 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 16:00:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a37f5af9-c1cb-430f-aa7f-3edeeb7cd525 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:41 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7170023-8fa1-41e7-92f0-212ed809cfc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42c09b95-5702-4499-b5e6-b52fad56de67', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:41 devstack sudo[90959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a37f5af9-c1cb-430f-aa7f-3edeeb7cd525 1073741824 Apr 25 16:00:41 devstack sudo[90959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:41 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055157bd-b224-487f-88f6-70ba0e799a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:41 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] Volume volume-42c09b95-5702-4499-b5e6-b52fad56de67 (42c09b95-5702-4499-b5e6-b52fad56de67): created successfully Apr 25 16:00:41 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055157bd-b224-487f-88f6-70ba0e799a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:41 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] Flow 'volume_create_manager' (fdcc4ae7-3db6-46b9-8c84-320581f9216b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:41 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-8637618a-7713-4917-9cb3-2338aef9c388 tempest-CreateVolumesFromSnapshotTest-289507390 None] Created volume successfully. Apr 25 16:00:41 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-09f577c2-0126-49f9-9299-0aa5f20c5c46 tempest-VolumeDependencyTests-1097684438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a.6ee1f20f-2517-4c26-a86a-0445e30a1d85" returned: 0 in 0.550s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:41 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-09f577c2-0126-49f9-9299-0aa5f20c5c46 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a.6ee1f20f-2517-4c26-a86a-0445e30a1d85 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:41 devstack sudo[90967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a.6ee1f20f-2517-4c26-a86a-0445e30a1d85 Apr 25 16:00:41 devstack sudo[90967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:42 devstack sudo[90959]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a37f5af9-c1cb-430f-aa7f-3edeeb7cd525 1073741824" returned: 0 in 0.649s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a37f5af9-c1cb-430f-aa7f-3edeeb7cd525 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:42 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a37f5af9-c1cb-430f-aa7f-3edeeb7cd525 Apr 25 16:00:42 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:42 devstack sudo[90967]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-09f577c2-0126-49f9-9299-0aa5f20c5c46 tempest-VolumeDependencyTests-1097684438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a.6ee1f20f-2517-4c26-a86a-0445e30a1d85" returned: 0 in 0.461s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:42 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-09f577c2-0126-49f9-9299-0aa5f20c5c46 tempest-VolumeDependencyTests-1097684438 None] Lock "cinder-quobyte-6ee1f20f-2517-4c26-a86a-0445e30a1d85" released by "_delete_snapshot" :: held 2.226s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:42 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-09f577c2-0126-49f9-9299-0aa5f20c5c46 tempest-VolumeDependencyTests-1097684438 None] Lock "cinder-quobyte-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a" released by "delete_snapshot" :: held 2.252s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:42 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-09f577c2-0126-49f9-9299-0aa5f20c5c46 tempest-VolumeDependencyTests-1097684438 None] Created reservations ['8c887b40-7173-41d9-a0ef-d03cc74fefe9', 'a486c650-45fb-4dde-ad91-13dea979bdcd', 'e8fffe27-d742-491d-b5e6-a44ebae224a2', 'e3bab4b4-2504-4640-a05e-1d596a27f1c3'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 16:00:42 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-09f577c2-0126-49f9-9299-0aa5f20c5c46 tempest-VolumeDependencyTests-1097684438 None] Delete snapshot completed successfully. Apr 25 16:00:42 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-09f577c2-0126-49f9-9299-0aa5f20c5c46 tempest-VolumeDependencyTests-1097684438 None] Lock "cinder-6ee1f20f-2517-4c26-a86a-0445e30a1d85-delete_snapshot" released by "delete_snapshot" :: held 2.393s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:42 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a37f5af9-c1cb-430f-aa7f-3edeeb7cd525" returned: 0 in 0.447s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:42 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 16:00:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.946s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:42 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-113246596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6497138-2215-4ab9-9bd1-39b1b9df29d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbfcded218554bb6afc32d8c14700f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:31Z,use_quota=True,user_id='025cf4a214cb4678bf7564822ef685d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 16:00:42 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] Creating volume c6497138-2215-4ab9-9bd1-39b1b9df29d6 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 16:00:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:42 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:00:42 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:00:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:42 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 16:00:42 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 16:00:42 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c6497138-2215-4ab9-9bd1-39b1b9df29d6 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b266271-67b8-467d-a57d-3319f9cf55aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a37f5af9-c1cb-430f-aa7f-3edeeb7cd525', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:42 devstack sudo[90974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c6497138-2215-4ab9-9bd1-39b1b9df29d6 1073741824 Apr 25 16:00:42 devstack sudo[90974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80f71e6-8036-4674-8414-087d7a2e9c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:42 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] Volume volume-a37f5af9-c1cb-430f-aa7f-3edeeb7cd525 (a37f5af9-c1cb-430f-aa7f-3edeeb7cd525): created successfully Apr 25 16:00:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80f71e6-8036-4674-8414-087d7a2e9c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:42 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] Flow 'volume_create_manager' (dc184acc-4c92-4287-9a3d-bedf1aa6b2af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:42 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-c5ab3b79-30f6-4bc8-b8bf-20db141593f8 tempest-CreateVolumesFromSnapshotTest-289507390 None] Created volume successfully. Apr 25 16:00:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7d09bdb6-f3f8-43fc-8f52-ed2686143bba tempest-VolumeDependencyTests-1097684438 None] Acquiring lock "cinder-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7d09bdb6-f3f8-43fc-8f52-ed2686143bba tempest-VolumeDependencyTests-1097684438 None] Lock "cinder-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:43 devstack sudo[90974]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c6497138-2215-4ab9-9bd1-39b1b9df29d6 1073741824" returned: 0 in 0.650s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7d09bdb6-f3f8-43fc-8f52-ed2686143bba tempest-VolumeDependencyTests-1097684438 None] Acquiring lock "cinder-quobyte-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:43 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7d09bdb6-f3f8-43fc-8f52-ed2686143bba tempest-VolumeDependencyTests-1097684438 None] Lock "cinder-quobyte-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a" acquired by "delete_volume" :: waited 0.024s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c6497138-2215-4ab9-9bd1-39b1b9df29d6 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:43 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc51893-5082-4dad-a108-08a1b36f50c4]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:00:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7d09bdb6-f3f8-43fc-8f52-ed2686143bba tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:43 devstack sudo[90979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c6497138-2215-4ab9-9bd1-39b1b9df29d6 Apr 25 16:00:43 devstack sudo[90979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:43 devstack sudo[90980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a Apr 25 16:00:43 devstack sudo[90980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:43 devstack sudo[90979]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c6497138-2215-4ab9-9bd1-39b1b9df29d6" returned: 0 in 0.439s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:43 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 16:00:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.815s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:43 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-427997528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bafdc4d-16b8-42ed-b9b5-0d72ee1276f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbfcded218554bb6afc32d8c14700f8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:32Z,use_quota=True,user_id='025cf4a214cb4678bf7564822ef685d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 16:00:43 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] Creating volume 1bafdc4d-16b8-42ed-b9b5-0d72ee1276f4 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 16:00:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:43 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:00:43 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:00:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:43 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 16:00:43 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 16:00:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1bafdc4d-16b8-42ed-b9b5-0d72ee1276f4 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:43 devstack sudo[90987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1bafdc4d-16b8-42ed-b9b5-0d72ee1276f4 1073741824 Apr 25 16:00:43 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae57735e-92a1-4bae-a29e-d054dc051cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6497138-2215-4ab9-9bd1-39b1b9df29d6', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65386ba0-ea77-45b8-99ea-2c5eaade9c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:43 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] Volume volume-c6497138-2215-4ab9-9bd1-39b1b9df29d6 (c6497138-2215-4ab9-9bd1-39b1b9df29d6): created successfully Apr 25 16:00:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65386ba0-ea77-45b8-99ea-2c5eaade9c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:43 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] Flow 'volume_create_manager' (4e69252b-6933-46ed-a68e-19797048bef3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:43 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-5c7b4c3a-4328-41a8-ba56-de700804bf8d tempest-CreateVolumesFromSnapshotTest-289507390 None] Created volume successfully. Apr 25 16:00:43 devstack sudo[90980]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7d09bdb6-f3f8-43fc-8f52-ed2686143bba tempest-VolumeDependencyTests-1097684438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a" returned: 0 in 0.523s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:43 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7d09bdb6-f3f8-43fc-8f52-ed2686143bba tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:43 devstack sudo[90989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a Apr 25 16:00:43 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:44 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7d09bdb6-f3f8-43fc-8f52-ed2686143bba tempest-VolumeDependencyTests-1097684438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a" returned: 0 in 0.466s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:44 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7d09bdb6-f3f8-43fc-8f52-ed2686143bba tempest-VolumeDependencyTests-1097684438 None] Lock "cinder-quobyte-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a" released by "delete_volume" :: held 1.049s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:44 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-7d09bdb6-f3f8-43fc-8f52-ed2686143bba tempest-VolumeDependencyTests-1097684438 None] Created reservations ['37ecd5cb-0180-476b-b750-9563a1c91ef3', '96c07cf0-892b-4cfc-a42a-c8eae35426aa', 'f030eb07-3450-4a81-a90d-17e1b8461e90', '1aeb8a3e-843b-447e-9271-8b86deb544d9'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 16:00:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7d09bdb6-f3f8-43fc-8f52-ed2686143bba tempest-VolumeDependencyTests-1097684438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7d09bdb6-f3f8-43fc-8f52-ed2686143bba tempest-VolumeDependencyTests-1097684438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-7d09bdb6-f3f8-43fc-8f52-ed2686143bba tempest-VolumeDependencyTests-1097684438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:00:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-7d09bdb6-f3f8-43fc-8f52-ed2686143bba tempest-VolumeDependencyTests-1097684438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:00:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7d09bdb6-f3f8-43fc-8f52-ed2686143bba tempest-VolumeDependencyTests-1097684438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7d09bdb6-f3f8-43fc-8f52-ed2686143bba tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:44 devstack sudo[90998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 16:00:44 devstack sudo[90998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:44 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1bafdc4d-16b8-42ed-b9b5-0d72ee1276f4 1073741824" returned: 0 in 0.716s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1bafdc4d-16b8-42ed-b9b5-0d72ee1276f4 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:44 devstack sudo[91000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1bafdc4d-16b8-42ed-b9b5-0d72ee1276f4 Apr 25 16:00:44 devstack sudo[91000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:44 devstack sudo[90998]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7d09bdb6-f3f8-43fc-8f52-ed2686143bba tempest-VolumeDependencyTests-1097684438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.459s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:44 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-7d09bdb6-f3f8-43fc-8f52-ed2686143bba tempest-VolumeDependencyTests-1097684438 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 16:00:44 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-7d09bdb6-f3f8-43fc-8f52-ed2686143bba tempest-VolumeDependencyTests-1097684438 None] Deleted volume successfully. Apr 25 16:00:44 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-7d09bdb6-f3f8-43fc-8f52-ed2686143bba tempest-VolumeDependencyTests-1097684438 None] Lock "cinder-bcf34d91-e3be-4166-87fe-3e0a3bb4d59a-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:44 devstack sudo[91000]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1bafdc4d-16b8-42ed-b9b5-0d72ee1276f4" returned: 0 in 0.446s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 16:00:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.032s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1287447451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bdea943-0c2c-45a4-b545-4ad3ae96084a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b8aa77d0314a8f826123125062e2bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:35Z,use_quota=True,user_id='04c373dc8248493da672689dc6ebf576',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 16:00:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] Creating volume 5bdea943-0c2c-45a4-b545-4ad3ae96084a {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 16:00:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:00:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:00:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:44 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 16:00:44 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 16:00:44 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:44 devstack sudo[91004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a 1073741824 Apr 25 16:00:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d9a2610-39b8-4b8c-afe5-c48c4132a998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bafdc4d-16b8-42ed-b9b5-0d72ee1276f4', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:44 devstack sudo[91004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce92d60b-eada-4cbf-b406-8e9031fb8b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:44 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] Volume volume-1bafdc4d-16b8-42ed-b9b5-0d72ee1276f4 (1bafdc4d-16b8-42ed-b9b5-0d72ee1276f4): created successfully Apr 25 16:00:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce92d60b-eada-4cbf-b406-8e9031fb8b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:44 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] Flow 'volume_create_manager' (44301683-e611-4a0b-8b46-b511a23e087a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:44 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-dce7bd1c-13d3-4f47-a465-3ac70f05f187 tempest-CreateVolumesFromSnapshotTest-289507390 None] Created volume successfully. Apr 25 16:00:45 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ea78621c-21de-4c73-9139-09f6a00356f5 tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "cinder-1bafdc4d-16b8-42ed-b9b5-0d72ee1276f4-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:45 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ea78621c-21de-4c73-9139-09f6a00356f5 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "cinder-1bafdc4d-16b8-42ed-b9b5-0d72ee1276f4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:45 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ea78621c-21de-4c73-9139-09f6a00356f5 tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "cinder-quobyte-1bafdc4d-16b8-42ed-b9b5-0d72ee1276f4" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:45 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ea78621c-21de-4c73-9139-09f6a00356f5 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "cinder-quobyte-1bafdc4d-16b8-42ed-b9b5-0d72ee1276f4" acquired by "delete_volume" :: waited 0.028s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:45 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79f7965-2bdb-451f-919f-ebc0a95c6604]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:00:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ea78621c-21de-4c73-9139-09f6a00356f5 tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1bafdc4d-16b8-42ed-b9b5-0d72ee1276f4 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:45 devstack sudo[91009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1bafdc4d-16b8-42ed-b9b5-0d72ee1276f4 Apr 25 16:00:45 devstack sudo[91009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:45 devstack sudo[91004]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a 1073741824" returned: 0 in 0.745s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:45 devstack sudo[91011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a Apr 25 16:00:45 devstack sudo[91011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:45 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 16:00:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] Flow 'volume_create_manager' (8fbec217-f322-4c3a-a1e2-7047002ec94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbfea56c-8e46-4ed8-8949-fa9e1a2c5a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbfea56c-8e46-4ed8-8949-fa9e1a2c5a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-144413168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98e75589-d72c-4015-8be9-506731f22af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c41e483c77a44fb7b9c182a2c5bc80b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:46Z,use_quota=True,user_id='29c5156637c04e1c9b82bceaa1b5fcf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aaf4be4-bcef-4953-84a0-fd4e75455ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0aaf4be4-bcef-4953-84a0-fd4e75455ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab90b118-d78c-4e94-b5c8-7bfb1fb1d1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab90b118-d78c-4e94-b5c8-7bfb1fb1d1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98e75589-d72c-4015-8be9-506731f22af0', 'volume_name': 'volume-98e75589-d72c-4015-8be9-506731f22af0', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94fb0d7c-fbaa-449e-9d38-cb4f125eca4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94fb0d7c-fbaa-449e-9d38-cb4f125eca4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:45 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad1fed09-2546-4091-a89e-851a229f7dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:45 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] Volume 98e75589-d72c-4015-8be9-506731f22af0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98e75589-d72c-4015-8be9-506731f22af0', 'volume_size': 1} Apr 25 16:00:45 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:46 devstack sudo[91009]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ea78621c-21de-4c73-9139-09f6a00356f5 tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1bafdc4d-16b8-42ed-b9b5-0d72ee1276f4" returned: 0 in 0.595s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ea78621c-21de-4c73-9139-09f6a00356f5 tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1bafdc4d-16b8-42ed-b9b5-0d72ee1276f4 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:46 devstack sudo[91016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1bafdc4d-16b8-42ed-b9b5-0d72ee1276f4 Apr 25 16:00:46 devstack sudo[91016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:46 devstack sudo[91011]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a" returned: 0 in 0.446s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:46 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 16:00:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.355s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:46 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:39Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e576b9c6-6793-4870-a7d3-9f73a5f6d989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c3ddb2ccc7d4b4bb1130f4beb5846ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:39Z,use_quota=True,user_id='cd9e85c64dbd449a9f311dac6374312c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 16:00:46 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] Creating volume e576b9c6-6793-4870-a7d3-9f73a5f6d989 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 16:00:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:46 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:00:46 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:00:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:46 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 16:00:46 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 16:00:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e576b9c6-6793-4870-a7d3-9f73a5f6d989 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (919f8c45-ad06-49e2-bb88-b327f1984af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:46 devstack sudo[91019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e576b9c6-6793-4870-a7d3-9f73a5f6d989 1073741824 Apr 25 16:00:46 devstack sudo[91019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e82f560-b676-4d0c-bdf8-8474cf751342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:46 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] Volume volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a (5bdea943-0c2c-45a4-b545-4ad3ae96084a): created successfully Apr 25 16:00:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e82f560-b676-4d0c-bdf8-8474cf751342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:46 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] Flow 'volume_create_manager' (eb3ecf36-795f-4dbc-a0ff-6ac6c22d4da1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:46 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-bfabb676-2c98-4e3d-8b1d-033be2f39760 tempest-SnapshotDependencyTests-30070103 None] Created volume successfully. Apr 25 16:00:46 devstack sudo[91016]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ea78621c-21de-4c73-9139-09f6a00356f5 tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-1bafdc4d-16b8-42ed-b9b5-0d72ee1276f4" returned: 0 in 0.460s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:46 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ea78621c-21de-4c73-9139-09f6a00356f5 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "cinder-quobyte-1bafdc4d-16b8-42ed-b9b5-0d72ee1276f4" released by "delete_volume" :: held 1.104s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:46 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-ea78621c-21de-4c73-9139-09f6a00356f5 tempest-CreateVolumesFromSnapshotTest-289507390 None] Created reservations ['b98f0131-ab1e-4880-9f70-bd9cb5b1cf97', '834a5841-7225-4950-a3dd-4ee1182e54ef', '64c92134-9169-4cf2-94c9-80bce92fd26b', '62ae7ee8-d0fa-4c79-bbc3-d8bac671ae0d'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 16:00:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ea78621c-21de-4c73-9139-09f6a00356f5 tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ea78621c-21de-4c73-9139-09f6a00356f5 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:46 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-ea78621c-21de-4c73-9139-09f6a00356f5 tempest-CreateVolumesFromSnapshotTest-289507390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:00:46 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-ea78621c-21de-4c73-9139-09f6a00356f5 tempest-CreateVolumesFromSnapshotTest-289507390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:00:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ea78621c-21de-4c73-9139-09f6a00356f5 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ea78621c-21de-4c73-9139-09f6a00356f5 tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:46 devstack sudo[91025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 16:00:46 devstack sudo[91025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-096035ef-6f96-45fd-bea1-5b4b79f8140c tempest-SnapshotDependencyTests-30070103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:46 devstack sudo[91019]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e576b9c6-6793-4870-a7d3-9f73a5f6d989 1073741824" returned: 0 in 0.693s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:46 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e576b9c6-6793-4870-a7d3-9f73a5f6d989 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:46 devstack sudo[91027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e576b9c6-6793-4870-a7d3-9f73a5f6d989 Apr 25 16:00:46 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:47 devstack sudo[91025]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ea78621c-21de-4c73-9139-09f6a00356f5 tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.503s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:47 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-ea78621c-21de-4c73-9139-09f6a00356f5 tempest-CreateVolumesFromSnapshotTest-289507390 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 16:00:47 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-ea78621c-21de-4c73-9139-09f6a00356f5 tempest-CreateVolumesFromSnapshotTest-289507390 None] Deleted volume successfully. Apr 25 16:00:47 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ea78621c-21de-4c73-9139-09f6a00356f5 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "cinder-1bafdc4d-16b8-42ed-b9b5-0d72ee1276f4-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:47 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e576b9c6-6793-4870-a7d3-9f73a5f6d989" returned: 0 in 0.455s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 16:00:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.487s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-144413168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98e75589-d72c-4015-8be9-506731f22af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c41e483c77a44fb7b9c182a2c5bc80b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:46Z,use_quota=True,user_id='29c5156637c04e1c9b82bceaa1b5fcf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 16:00:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] Creating volume 98e75589-d72c-4015-8be9-506731f22af0 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 16:00:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:00:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:00:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:47 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 16:00:47 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 16:00:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76bdd47-665a-4b8f-bed0-092f1553dfb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e576b9c6-6793-4870-a7d3-9f73a5f6d989', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:47 devstack sudo[91031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0 1073741824 Apr 25 16:00:47 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (509dd561-b25a-405e-82cb-f0ff17c64e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:47 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] Volume volume-e576b9c6-6793-4870-a7d3-9f73a5f6d989 (e576b9c6-6793-4870-a7d3-9f73a5f6d989): created successfully Apr 25 16:00:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (509dd561-b25a-405e-82cb-f0ff17c64e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:47 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] Flow 'volume_create_manager' (de153b0b-1f80-499a-8ecd-6ca0da40c3d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:47 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-7f99c361-41ab-44d0-b257-3c137d817b22 tempest-CinderUnicodeTest-593846682 None] Created volume successfully. Apr 25 16:00:47 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-41dc14aa-727b-4d3d-93ab-dbd111f51e62 tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "cinder-c6497138-2215-4ab9-9bd1-39b1b9df29d6-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:47 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-41dc14aa-727b-4d3d-93ab-dbd111f51e62 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "cinder-c6497138-2215-4ab9-9bd1-39b1b9df29d6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:47 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-41dc14aa-727b-4d3d-93ab-dbd111f51e62 tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "cinder-quobyte-c6497138-2215-4ab9-9bd1-39b1b9df29d6" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:47 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-41dc14aa-727b-4d3d-93ab-dbd111f51e62 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "cinder-quobyte-c6497138-2215-4ab9-9bd1-39b1b9df29d6" acquired by "delete_volume" :: waited 0.015s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:47 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5a7539-a40a-43d3-ad38-b2150f433995]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:00:47 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-41dc14aa-727b-4d3d-93ab-dbd111f51e62 tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c6497138-2215-4ab9-9bd1-39b1b9df29d6 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:47 devstack sudo[91033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c6497138-2215-4ab9-9bd1-39b1b9df29d6 Apr 25 16:00:47 devstack sudo[91033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:48 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0 1073741824" returned: 0 in 0.657s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:48 devstack sudo[91038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0 Apr 25 16:00:48 devstack sudo[91038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:48 devstack sudo[91033]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-41dc14aa-727b-4d3d-93ab-dbd111f51e62 tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c6497138-2215-4ab9-9bd1-39b1b9df29d6" returned: 0 in 0.598s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-41dc14aa-727b-4d3d-93ab-dbd111f51e62 tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c6497138-2215-4ab9-9bd1-39b1b9df29d6 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:48 devstack sudo[91043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c6497138-2215-4ab9-9bd1-39b1b9df29d6 Apr 25 16:00:48 devstack sudo[91043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:48 devstack sudo[91038]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0" returned: 0 in 0.527s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.226s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-096035ef-6f96-45fd-bea1-5b4b79f8140c tempest-SnapshotDependencyTests-30070103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.776s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad1fed09-2546-4091-a89e-851a229f7dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98e75589-d72c-4015-8be9-506731f22af0', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5deca8df-e622-4b47-b5bc-f672e32452b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-096035ef-6f96-45fd-bea1-5b4b79f8140c tempest-SnapshotDependencyTests-30070103 None] Creating offline snapshot f9d12a44-b28b-43f5-bf21-e2601cdcd763 of volume 5bdea943-0c2c-45a4-b545-4ad3ae96084a {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 16:00:48 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] Volume volume-98e75589-d72c-4015-8be9-506731f22af0 (98e75589-d72c-4015-8be9-506731f22af0): created successfully Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5deca8df-e622-4b47-b5bc-f672e32452b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] Flow 'volume_create_manager' (8fbec217-f322-4c3a-a1e2-7047002ec94e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4fce90-e4ba-4f49-93d9-b4b1a7d69f1c]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-096035ef-6f96-45fd-bea1-5b4b79f8140c tempest-SnapshotDependencyTests-30070103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:48 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-2bb92c54-02ed-45fc-bd77-d128521f3c36 tempest-VolumeDependencyTests-1097684438 None] Created volume successfully. Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 16:00:48 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a Apr 25 16:00:48 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] Flow 'volume_create_manager' (f1210fa9-c014-4ae8-898a-f4c358096cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1ad6ad-8ac1-408d-92d4-406a5be4fb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:48 devstack sudo[91043]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1ad6ad-8ac1-408d-92d4-406a5be4fb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:48Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-511892508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7736c4f-4b5d-4747-a3d6-2406c584d890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c3ddb2ccc7d4b4bb1130f4beb5846ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:49Z,use_quota=True,user_id='cd9e85c64dbd449a9f311dac6374312c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34734450-e8ed-4978-86a4-524d8ee6072f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34734450-e8ed-4978-86a4-524d8ee6072f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (809eae29-3448-4fc0-b70f-936463e19da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (809eae29-3448-4fc0-b70f-936463e19da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7736c4f-4b5d-4747-a3d6-2406c584d890', 'volume_name': 'volume-b7736c4f-4b5d-4747-a3d6-2406c584d890', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24d0b5fb-56fd-4e2e-94da-ec3ca8028510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24d0b5fb-56fd-4e2e-94da-ec3ca8028510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b322bbd2-829a-4eed-acc8-2314a8fe6af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:48 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] Volume b7736c4f-4b5d-4747-a3d6-2406c584d890: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7736c4f-4b5d-4747-a3d6-2406c584d890', 'volume_size': 1} Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-41dc14aa-727b-4d3d-93ab-dbd111f51e62 tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c6497138-2215-4ab9-9bd1-39b1b9df29d6" returned: 0 in 0.602s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-41dc14aa-727b-4d3d-93ab-dbd111f51e62 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "cinder-quobyte-c6497138-2215-4ab9-9bd1-39b1b9df29d6" released by "delete_volume" :: held 1.246s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-41dc14aa-727b-4d3d-93ab-dbd111f51e62 tempest-CreateVolumesFromSnapshotTest-289507390 None] Created reservations ['a4390685-4b02-49e0-97a5-538c0f3259d3', '1a56c8a8-e0b4-4a43-9b9c-e2407715c4d7', 'fa6aa0fd-651c-4bfd-87b5-2f2cda72ede6', '42ac5d3f-79c3-4d6f-a8b4-29d1eab48f43'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-41dc14aa-727b-4d3d-93ab-dbd111f51e62 tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-41dc14aa-727b-4d3d-93ab-dbd111f51e62 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-41dc14aa-727b-4d3d-93ab-dbd111f51e62 tempest-CreateVolumesFromSnapshotTest-289507390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-41dc14aa-727b-4d3d-93ab-dbd111f51e62 tempest-CreateVolumesFromSnapshotTest-289507390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-41dc14aa-727b-4d3d-93ab-dbd111f51e62 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:48 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-41dc14aa-727b-4d3d-93ab-dbd111f51e62 tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:48 devstack sudo[91049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 16:00:48 devstack sudo[91049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:49 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-096035ef-6f96-45fd-bea1-5b4b79f8140c tempest-SnapshotDependencyTests-30070103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a" returned: 0 in 0.584s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-096035ef-6f96-45fd-bea1-5b4b79f8140c tempest-SnapshotDependencyTests-30070103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a.f9d12a44-b28b-43f5-bf21-e2601cdcd763 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:49 devstack sudo[91054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a.f9d12a44-b28b-43f5-bf21-e2601cdcd763 1G Apr 25 16:00:49 devstack sudo[91054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:49 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 16:00:49 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Flow 'volume_create_manager' (56936bc4-2004-41fa-96f5-e0011c045728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:49 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e601c3-e4cd-48cc-8f97-2aae0f400bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:49 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e601c3-e4cd-48cc-8f97-2aae0f400bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1787868684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c41e483c77a44fb7b9c182a2c5bc80b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=98e75589-d72c-4015-8be9-506731f22af0,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:49Z,use_quota=True,user_id='29c5156637c04e1c9b82bceaa1b5fcf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:49 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb09142-4284-435f-85fb-01fb02849d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:49 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb09142-4284-435f-85fb-01fb02849d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:49 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e23212-4817-4981-a9fc-1a7dc7765ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:49 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e23212-4817-4981-a9fc-1a7dc7765ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee', 'volume_name': 'volume-c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee', 'volume_size': 1, 'source_volid': '98e75589-d72c-4015-8be9-506731f22af0', 'source_volstatus': 'available'}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:49 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba2aa24-839d-49f6-aa85-f82676769d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:49 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fba2aa24-839d-49f6-aa85-f82676769d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:49 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720dc7ea-f0fc-4934-a1bb-f4f65d9359b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:49 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Volume c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee', 'volume_size': 1, 'source_volid': '98e75589-d72c-4015-8be9-506731f22af0', 'source_volstatus': 'available'} Apr 25 16:00:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:49 devstack sudo[91049]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-41dc14aa-727b-4d3d-93ab-dbd111f51e62 tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.524s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:49 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-41dc14aa-727b-4d3d-93ab-dbd111f51e62 tempest-CreateVolumesFromSnapshotTest-289507390 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 16:00:49 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-41dc14aa-727b-4d3d-93ab-dbd111f51e62 tempest-CreateVolumesFromSnapshotTest-289507390 None] Deleted volume successfully. Apr 25 16:00:49 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-41dc14aa-727b-4d3d-93ab-dbd111f51e62 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "cinder-c6497138-2215-4ab9-9bd1-39b1b9df29d6-delete_volume" released by "delete_volume" :: held 1.967s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:49 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-2221ba6f-f81f-47dd-bea1-3ec801f2a5d7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "cinder-a37f5af9-c1cb-430f-aa7f-3edeeb7cd525-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:49 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-2221ba6f-f81f-47dd-bea1-3ec801f2a5d7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "cinder-a37f5af9-c1cb-430f-aa7f-3edeeb7cd525-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:49 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-2221ba6f-f81f-47dd-bea1-3ec801f2a5d7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "cinder-quobyte-a37f5af9-c1cb-430f-aa7f-3edeeb7cd525" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:49 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-2221ba6f-f81f-47dd-bea1-3ec801f2a5d7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "cinder-quobyte-a37f5af9-c1cb-430f-aa7f-3edeeb7cd525" acquired by "delete_volume" :: waited 0.023s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:49 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b3c55a-9e09-4a67-a4e6-ee0aa6e55448]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:00:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2221ba6f-f81f-47dd-bea1-3ec801f2a5d7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a37f5af9-c1cb-430f-aa7f-3edeeb7cd525 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:49 devstack sudo[91054]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-096035ef-6f96-45fd-bea1-5b4b79f8140c tempest-SnapshotDependencyTests-30070103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a.f9d12a44-b28b-43f5-bf21-e2601cdcd763 1G" returned: 0 in 0.675s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:49 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-096035ef-6f96-45fd-bea1-5b4b79f8140c tempest-SnapshotDependencyTests-30070103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a.f9d12a44-b28b-43f5-bf21-e2601cdcd763 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:49 devstack sudo[91060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a37f5af9-c1cb-430f-aa7f-3edeeb7cd525 Apr 25 16:00:49 devstack sudo[91060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:49 devstack sudo[91061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a.f9d12a44-b28b-43f5-bf21-e2601cdcd763 Apr 25 16:00:49 devstack sudo[91061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:50 devstack sudo[91060]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2221ba6f-f81f-47dd-bea1-3ec801f2a5d7 tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a37f5af9-c1cb-430f-aa7f-3edeeb7cd525" returned: 0 in 0.539s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:50 devstack sudo[91061]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2221ba6f-f81f-47dd-bea1-3ec801f2a5d7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a37f5af9-c1cb-430f-aa7f-3edeeb7cd525 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-096035ef-6f96-45fd-bea1-5b4b79f8140c tempest-SnapshotDependencyTests-30070103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a.f9d12a44-b28b-43f5-bf21-e2601cdcd763" returned: 0 in 0.484s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:50 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-096035ef-6f96-45fd-bea1-5b4b79f8140c tempest-SnapshotDependencyTests-30070103 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a.f9d12a44-b28b-43f5-bf21-e2601cdcd763 is being set with open permissions: ugo+rw Apr 25 16:00:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-096035ef-6f96-45fd-bea1-5b4b79f8140c tempest-SnapshotDependencyTests-30070103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a.f9d12a44-b28b-43f5-bf21-e2601cdcd763 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:50 devstack sudo[91070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a37f5af9-c1cb-430f-aa7f-3edeeb7cd525 Apr 25 16:00:50 devstack sudo[91070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:50 devstack sudo[91071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a.f9d12a44-b28b-43f5-bf21-e2601cdcd763 Apr 25 16:00:50 devstack sudo[91071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:50 devstack sudo[91071]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:50 devstack sudo[91070]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2221ba6f-f81f-47dd-bea1-3ec801f2a5d7 tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-a37f5af9-c1cb-430f-aa7f-3edeeb7cd525" returned: 0 in 0.456s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-096035ef-6f96-45fd-bea1-5b4b79f8140c tempest-SnapshotDependencyTests-30070103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a.f9d12a44-b28b-43f5-bf21-e2601cdcd763" returned: 0 in 0.457s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:50 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-2221ba6f-f81f-47dd-bea1-3ec801f2a5d7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "cinder-quobyte-a37f5af9-c1cb-430f-aa7f-3edeeb7cd525" released by "delete_volume" :: held 1.058s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:50 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-096035ef-6f96-45fd-bea1-5b4b79f8140c tempest-SnapshotDependencyTests-30070103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:50 devstack sudo[91076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a.info Apr 25 16:00:50 devstack sudo[91076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:50 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-2221ba6f-f81f-47dd-bea1-3ec801f2a5d7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Created reservations ['34233753-de36-4d65-ab92-1d540c91cdf2', '8d49a3e9-53d5-41c6-a606-80351d91f092', '19efdfba-5b97-4a44-b8e7-aa09b2b53296', 'c1e5b07d-35ff-4082-a388-95ffc7ba291d'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 16:00:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-2221ba6f-f81f-47dd-bea1-3ec801f2a5d7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-2221ba6f-f81f-47dd-bea1-3ec801f2a5d7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:51 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-2221ba6f-f81f-47dd-bea1-3ec801f2a5d7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:00:51 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-2221ba6f-f81f-47dd-bea1-3ec801f2a5d7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:00:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-2221ba6f-f81f-47dd-bea1-3ec801f2a5d7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2221ba6f-f81f-47dd-bea1-3ec801f2a5d7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:51 devstack sudo[91078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 16:00:51 devstack sudo[91078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:51 devstack sudo[91076]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-096035ef-6f96-45fd-bea1-5b4b79f8140c tempest-SnapshotDependencyTests-30070103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a.info" returned: 0 in 0.467s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:51 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-096035ef-6f96-45fd-bea1-5b4b79f8140c tempest-SnapshotDependencyTests-30070103 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a.info is being set with open permissions: ugo+rw Apr 25 16:00:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-096035ef-6f96-45fd-bea1-5b4b79f8140c tempest-SnapshotDependencyTests-30070103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:51 devstack sudo[91088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a.info Apr 25 16:00:51 devstack sudo[91088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:51 devstack sudo[91078]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2221ba6f-f81f-47dd-bea1-3ec801f2a5d7 tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.425s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:51 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-2221ba6f-f81f-47dd-bea1-3ec801f2a5d7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 16:00:51 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-2221ba6f-f81f-47dd-bea1-3ec801f2a5d7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Deleted volume successfully. Apr 25 16:00:51 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-2221ba6f-f81f-47dd-bea1-3ec801f2a5d7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "cinder-a37f5af9-c1cb-430f-aa7f-3edeeb7cd525-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:51 devstack sudo[91088]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-096035ef-6f96-45fd-bea1-5b4b79f8140c tempest-SnapshotDependencyTests-30070103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a.info" returned: 0 in 0.440s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-096035ef-6f96-45fd-bea1-5b4b79f8140c tempest-SnapshotDependencyTests-30070103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.278s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.045s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:51 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:48Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-511892508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7736c4f-4b5d-4747-a3d6-2406c584d890,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c3ddb2ccc7d4b4bb1130f4beb5846ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:49Z,use_quota=True,user_id='cd9e85c64dbd449a9f311dac6374312c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 16:00:51 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] Creating volume b7736c4f-4b5d-4747-a3d6-2406c584d890 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 16:00:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:51 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:00:51 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:00:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:51 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 16:00:51 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 16:00:51 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:51 devstack sudo[91092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890 1073741824 Apr 25 16:00:51 devstack sudo[91092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:51 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-096035ef-6f96-45fd-bea1-5b4b79f8140c tempest-SnapshotDependencyTests-30070103 None] Create snapshot completed successfully Apr 25 16:00:51 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b9d70937-43b9-4d18-b826-343f7995bfce tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "cinder-42c09b95-5702-4499-b5e6-b52fad56de67-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:52 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b9d70937-43b9-4d18-b826-343f7995bfce tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "cinder-42c09b95-5702-4499-b5e6-b52fad56de67-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:52 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b9d70937-43b9-4d18-b826-343f7995bfce tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "cinder-quobyte-42c09b95-5702-4499-b5e6-b52fad56de67" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:52 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b9d70937-43b9-4d18-b826-343f7995bfce tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "cinder-quobyte-42c09b95-5702-4499-b5e6-b52fad56de67" acquired by "delete_volume" :: waited 0.029s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:52 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[c091eec7-365e-47ab-a4a1-83f5455fff12]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:00:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b9d70937-43b9-4d18-b826-343f7995bfce tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-42c09b95-5702-4499-b5e6-b52fad56de67 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:52 devstack sudo[91094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-42c09b95-5702-4499-b5e6-b52fad56de67 Apr 25 16:00:52 devstack sudo[91094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:52 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 16:00:52 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Flow 'volume_create_manager' (e9570671-5319-4a30-9233-23eb17cebb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:52 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae8cb99b-77cf-4f97-a70d-5d75f1c1da73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:52 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae8cb99b-77cf-4f97-a70d-5d75f1c1da73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8b8aa77d0314a8f826123125062e2bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f9d12a44-b28b-43f5-bf21-e2601cdcd763,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:00:52Z,use_quota=True,user_id='04c373dc8248493da672689dc6ebf576',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:52 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57261015-009f-497d-87c3-8d41fce35caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:52 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57261015-009f-497d-87c3-8d41fce35caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:52 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77363fbb-29e9-4ec8-8390-b97defd7c603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:52 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77363fbb-29e9-4ec8-8390-b97defd7c603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae', 'volume_name': 'volume-633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae', 'volume_size': 1, 'snapshot_id': 'f9d12a44-b28b-43f5-bf21-e2601cdcd763'}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:52 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9b3af7-3e36-4cf4-bb02-5f6b26d18b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:52 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9b3af7-3e36-4cf4-bb02-5f6b26d18b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:52 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91ed9e8d-bbc5-481c-b1e9-8f323fe83238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:52 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Volume 633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae', 'volume_size': 1, 'snapshot_id': 'f9d12a44-b28b-43f5-bf21-e2601cdcd763'} Apr 25 16:00:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:52 devstack sudo[91092]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890 1073741824" returned: 0 in 0.744s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:52 devstack sudo[91094]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:52 devstack sudo[91102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890 Apr 25 16:00:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b9d70937-43b9-4d18-b826-343f7995bfce tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-42c09b95-5702-4499-b5e6-b52fad56de67" returned: 0 in 0.586s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:52 devstack sudo[91102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:52 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b9d70937-43b9-4d18-b826-343f7995bfce tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-42c09b95-5702-4499-b5e6-b52fad56de67 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:52 devstack sudo[91104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-42c09b95-5702-4499-b5e6-b52fad56de67 Apr 25 16:00:52 devstack sudo[91104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:53 devstack sudo[91102]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890" returned: 0 in 0.441s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:53 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 16:00:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.661s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:53 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Cloning volume 98e75589-d72c-4015-8be9-506731f22af0 to volume c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee Apr 25 16:00:53 devstack sudo[91104]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:53 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b322bbd2-829a-4eed-acc8-2314a8fe6af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7736c4f-4b5d-4747-a3d6-2406c584d890', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:53 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c27d19be-8053-4c9b-9f4a-f65002d6196c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:00:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b9d70937-43b9-4d18-b826-343f7995bfce tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-42c09b95-5702-4499-b5e6-b52fad56de67" returned: 0 in 0.458s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:53 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] Volume volume-b7736c4f-4b5d-4747-a3d6-2406c584d890 (b7736c4f-4b5d-4747-a3d6-2406c584d890): created successfully Apr 25 16:00:53 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c27d19be-8053-4c9b-9f4a-f65002d6196c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:00:53 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] Flow 'volume_create_manager' (f1210fa9-c014-4ae8-898a-f4c358096cf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:00:53 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b9d70937-43b9-4d18-b826-343f7995bfce tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "cinder-quobyte-42c09b95-5702-4499-b5e6-b52fad56de67" released by "delete_volume" :: held 1.107s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:53 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Creating offline snapshot a52280c6-d8f6-49e6-90b2-e0ef6e94e598 of volume 98e75589-d72c-4015-8be9-506731f22af0 {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 16:00:53 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-7bb26170-4851-4b18-a55c-ee6608788e61 tempest-CinderUnicodeTest-593846682 None] Created volume successfully. Apr 25 16:00:53 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[095bfea3-8bcf-41c0-9d11-bb8bd78f7978]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:00:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:53 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-b9d70937-43b9-4d18-b826-343f7995bfce tempest-CreateVolumesFromSnapshotTest-289507390 None] Created reservations ['b864acbb-3c36-44de-8137-eb45346b5568', '7c0dcbff-8f67-4227-a1cc-fc70f05d0140', '127180ac-9a43-440b-bbcd-2157e5e12c0c', 'bd76526f-54e2-4756-bbb2-d2b45d70c869'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 16:00:53 devstack sudo[91108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0 Apr 25 16:00:53 devstack sudo[91108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b9d70937-43b9-4d18-b826-343f7995bfce tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b9d70937-43b9-4d18-b826-343f7995bfce tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:53 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b9d70937-43b9-4d18-b826-343f7995bfce tempest-CreateVolumesFromSnapshotTest-289507390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:00:53 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b9d70937-43b9-4d18-b826-343f7995bfce tempest-CreateVolumesFromSnapshotTest-289507390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:00:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b9d70937-43b9-4d18-b826-343f7995bfce tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b9d70937-43b9-4d18-b826-343f7995bfce tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:53 devstack sudo[91110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 16:00:53 devstack sudo[91110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:53 devstack sudo[91110]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b9d70937-43b9-4d18-b826-343f7995bfce tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.422s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:53 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-b9d70937-43b9-4d18-b826-343f7995bfce tempest-CreateVolumesFromSnapshotTest-289507390 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 16:00:53 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-b9d70937-43b9-4d18-b826-343f7995bfce tempest-CreateVolumesFromSnapshotTest-289507390 None] Deleted volume successfully. Apr 25 16:00:53 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b9d70937-43b9-4d18-b826-343f7995bfce tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "cinder-42c09b95-5702-4499-b5e6-b52fad56de67-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:53 devstack sudo[91108]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0" returned: 0 in 0.590s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:53 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0.a52280c6-d8f6-49e6-90b2-e0ef6e94e598 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:53 devstack sudo[91116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0.a52280c6-d8f6-49e6-90b2-e0ef6e94e598 1G Apr 25 16:00:53 devstack sudo[91116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:54 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b50dcc7b-a652-4035-b14a-ed184df3f1e7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "cinder-e9dc45a6-13bd-46f9-89a8-be480f8cb024-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-22d72e36-fb56-4c74-ace9-81d287da3133 tempest-CinderUnicodeTest-593846682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:54 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b50dcc7b-a652-4035-b14a-ed184df3f1e7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "cinder-e9dc45a6-13bd-46f9-89a8-be480f8cb024-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:54 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b50dcc7b-a652-4035-b14a-ed184df3f1e7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "cinder-quobyte-e9dc45a6-13bd-46f9-89a8-be480f8cb024" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:54 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b50dcc7b-a652-4035-b14a-ed184df3f1e7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "cinder-quobyte-e9dc45a6-13bd-46f9-89a8-be480f8cb024" acquired by "delete_volume" :: waited 0.018s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:54 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[81df5760-017b-4989-ab73-5996ad0db92a]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:00:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b50dcc7b-a652-4035-b14a-ed184df3f1e7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e9dc45a6-13bd-46f9-89a8-be480f8cb024 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:54 devstack sudo[91121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e9dc45a6-13bd-46f9-89a8-be480f8cb024 Apr 25 16:00:54 devstack sudo[91121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:54 devstack sudo[91116]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0.a52280c6-d8f6-49e6-90b2-e0ef6e94e598 1G" returned: 0 in 0.685s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98e75589-d72c-4015-8be9-506731f22af0 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0.a52280c6-d8f6-49e6-90b2-e0ef6e94e598 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:54 devstack sudo[91123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98e75589-d72c-4015-8be9-506731f22af0 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0.a52280c6-d8f6-49e6-90b2-e0ef6e94e598 Apr 25 16:00:54 devstack sudo[91123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:54 devstack sudo[91121]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b50dcc7b-a652-4035-b14a-ed184df3f1e7 tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e9dc45a6-13bd-46f9-89a8-be480f8cb024" returned: 0 in 0.543s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b50dcc7b-a652-4035-b14a-ed184df3f1e7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e9dc45a6-13bd-46f9-89a8-be480f8cb024 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:54 devstack sudo[91131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e9dc45a6-13bd-46f9-89a8-be480f8cb024 Apr 25 16:00:54 devstack sudo[91131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:54 devstack sudo[91123]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98e75589-d72c-4015-8be9-506731f22af0 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0.a52280c6-d8f6-49e6-90b2-e0ef6e94e598" returned: 0 in 0.504s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:54 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0.a52280c6-d8f6-49e6-90b2-e0ef6e94e598 is being set with open permissions: ugo+rw Apr 25 16:00:54 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0.a52280c6-d8f6-49e6-90b2-e0ef6e94e598 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:55 devstack sudo[91133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0.a52280c6-d8f6-49e6-90b2-e0ef6e94e598 Apr 25 16:00:55 devstack sudo[91133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:55 devstack sudo[91131]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b50dcc7b-a652-4035-b14a-ed184df3f1e7 tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e9dc45a6-13bd-46f9-89a8-be480f8cb024" returned: 0 in 0.430s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:55 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b50dcc7b-a652-4035-b14a-ed184df3f1e7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "cinder-quobyte-e9dc45a6-13bd-46f9-89a8-be480f8cb024" released by "delete_volume" :: held 1.018s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:55 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-b50dcc7b-a652-4035-b14a-ed184df3f1e7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Created reservations ['0d8b97aa-9594-4c21-b31a-b59206222267', 'f07c3880-cf81-4d03-92b1-438d9d8f8463', '3299b7b7-f2ab-4d2b-b787-5c6d261f178d', '7de117a7-0cc4-4506-ae1f-6b39880ec787'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 16:00:55 devstack sudo[91133]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0.a52280c6-d8f6-49e6-90b2-e0ef6e94e598" returned: 0 in 0.476s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b50dcc7b-a652-4035-b14a-ed184df3f1e7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b50dcc7b-a652-4035-b14a-ed184df3f1e7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:55 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b50dcc7b-a652-4035-b14a-ed184df3f1e7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:00:55 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b50dcc7b-a652-4035-b14a-ed184df3f1e7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:00:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b50dcc7b-a652-4035-b14a-ed184df3f1e7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b50dcc7b-a652-4035-b14a-ed184df3f1e7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:55 devstack sudo[91137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 16:00:55 devstack sudo[91137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:55 devstack sudo[91138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0.info Apr 25 16:00:55 devstack sudo[91138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:55 devstack sudo[91137]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b50dcc7b-a652-4035-b14a-ed184df3f1e7 tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.433s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:55 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-b50dcc7b-a652-4035-b14a-ed184df3f1e7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 16:00:55 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-b50dcc7b-a652-4035-b14a-ed184df3f1e7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Deleted volume successfully. Apr 25 16:00:55 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b50dcc7b-a652-4035-b14a-ed184df3f1e7 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "cinder-e9dc45a6-13bd-46f9-89a8-be480f8cb024-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:55 devstack sudo[91138]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0.info" returned: 0 in 0.465s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:55 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0.info is being set with open permissions: ugo+rw Apr 25 16:00:55 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:55 devstack sudo[91143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0.info Apr 25 16:00:55 devstack sudo[91143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:56 devstack sudo[91143]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0.info" returned: 0 in 0.428s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:56 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Acquiring lock "cinder-quobyte-c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee" by "_copy_volume_from_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:56 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Lock "cinder-quobyte-c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:56 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] snapshot: a52280c6-d8f6-49e6-90b2-e0ef6e94e598, volume: c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee, {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 25 16:00:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:00:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:00:56 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:00:56 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:00:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:00:56 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fe8cab-07e2-4860-aefd-b2e2e1c8a895]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:00:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0.a52280c6-d8f6-49e6-90b2-e0ef6e94e598 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:56 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-1011fc14-0a9b-4c92-8fc3-9b3d071f5ef0 tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "cinder-5fd16a0f-16bb-4ce5-b48b-aba9549fc148-delete_snapshot" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:56 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-1011fc14-0a9b-4c92-8fc3-9b3d071f5ef0 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "cinder-5fd16a0f-16bb-4ce5-b48b-aba9549fc148-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:56 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-1011fc14-0a9b-4c92-8fc3-9b3d071f5ef0 tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "cinder-quobyte-81b299f6-b05a-4c7e-9b91-b4ab7cc21901" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:56 devstack sudo[91146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0.a52280c6-d8f6-49e6-90b2-e0ef6e94e598 Apr 25 16:00:56 devstack sudo[91146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:56 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-1011fc14-0a9b-4c92-8fc3-9b3d071f5ef0 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "cinder-quobyte-81b299f6-b05a-4c7e-9b91-b4ab7cc21901" acquired by "delete_snapshot" :: waited 0.019s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:56 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-1011fc14-0a9b-4c92-8fc3-9b3d071f5ef0 tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "cinder-quobyte-5fd16a0f-16bb-4ce5-b48b-aba9549fc148" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:00:56 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-1011fc14-0a9b-4c92-8fc3-9b3d071f5ef0 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "cinder-quobyte-5fd16a0f-16bb-4ce5-b48b-aba9549fc148" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:00:56 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-1011fc14-0a9b-4c92-8fc3-9b3d071f5ef0 tempest-CreateVolumesFromSnapshotTest-289507390 None] Deleting offline snapshot 5fd16a0f-16bb-4ce5-b48b-aba9549fc148 of volume 81b299f6-b05a-4c7e-9b91-b4ab7cc21901 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 16:00:56 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-1011fc14-0a9b-4c92-8fc3-9b3d071f5ef0 tempest-CreateVolumesFromSnapshotTest-289507390 None] snapshot_file for this snap is: volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901.5fd16a0f-16bb-4ce5-b48b-aba9549fc148 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 16:00:56 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[af782806-48e7-43d8-bbd4-38647834a419]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:00:56 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1011fc14-0a9b-4c92-8fc3-9b3d071f5ef0 tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901.5fd16a0f-16bb-4ce5-b48b-aba9549fc148 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:56 devstack sudo[91148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901.5fd16a0f-16bb-4ce5-b48b-aba9549fc148 Apr 25 16:00:56 devstack sudo[91148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:57 devstack sudo[91146]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0.a52280c6-d8f6-49e6-90b2-e0ef6e94e598" returned: 0 in 0.561s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:57 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98e75589-d72c-4015-8be9-506731f22af0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 16:00:57 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] will copy from snapshot at /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0 {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 25 16:00:57 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Creating direct copy from snapshot {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 25 16:00:57 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c60b81f-fd0d-4985-8075-1aa2a0a0e68e]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:00:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:57 devstack sudo[91156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0 Apr 25 16:00:57 devstack sudo[91156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:57 devstack sudo[91148]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1011fc14-0a9b-4c92-8fc3-9b3d071f5ef0 tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901.5fd16a0f-16bb-4ce5-b48b-aba9549fc148" returned: 0 in 0.537s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:57 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-1011fc14-0a9b-4c92-8fc3-9b3d071f5ef0 tempest-CreateVolumesFromSnapshotTest-289507390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 16:00:57 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb5e683-0b7f-4906-9816-d2335f9d1ecb]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:00:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1011fc14-0a9b-4c92-8fc3-9b3d071f5ef0 tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:57 devstack sudo[91158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901 Apr 25 16:00:57 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:57 devstack sudo[91156]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0" returned: 0 in 0.515s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:57 devstack cinder-volume[81828]: DEBUG cinder.utils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Path /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee not found in is_blk_device check {{(pid=81828) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 25 16:00:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:57 devstack sudo[91163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee Apr 25 16:00:57 devstack sudo[91163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:57 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1011fc14-0a9b-4c92-8fc3-9b3d071f5ef0 tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901" returned: 0 in 0.538s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:57 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1011fc14-0a9b-4c92-8fc3-9b3d071f5ef0 tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901.5fd16a0f-16bb-4ce5-b48b-aba9549fc148 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:57 devstack sudo[91168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901.5fd16a0f-16bb-4ce5-b48b-aba9549fc148 Apr 25 16:00:57 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:58 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1011fc14-0a9b-4c92-8fc3-9b3d071f5ef0 tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901.5fd16a0f-16bb-4ce5-b48b-aba9549fc148" returned: 0 in 0.731s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:58 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1011fc14-0a9b-4c92-8fc3-9b3d071f5ef0 tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901.5fd16a0f-16bb-4ce5-b48b-aba9549fc148 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:00:58 devstack sudo[91183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901.5fd16a0f-16bb-4ce5-b48b-aba9549fc148 Apr 25 16:00:58 devstack sudo[91183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:00:59 devstack sudo[91183]: pam_unix(sudo:session): session closed for user root Apr 25 16:00:59 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1011fc14-0a9b-4c92-8fc3-9b3d071f5ef0 tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901.5fd16a0f-16bb-4ce5-b48b-aba9549fc148" returned: 0 in 1.018s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:00:59 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-1011fc14-0a9b-4c92-8fc3-9b3d071f5ef0 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "cinder-quobyte-5fd16a0f-16bb-4ce5-b48b-aba9549fc148" released by "_delete_snapshot" :: held 2.967s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:59 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-1011fc14-0a9b-4c92-8fc3-9b3d071f5ef0 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "cinder-quobyte-81b299f6-b05a-4c7e-9b91-b4ab7cc21901" released by "delete_snapshot" :: held 2.997s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:00:59 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-1011fc14-0a9b-4c92-8fc3-9b3d071f5ef0 tempest-CreateVolumesFromSnapshotTest-289507390 None] Created reservations ['c9dbe6fd-fbd4-4304-97ce-0efe31dc9418', 'cfc69786-6024-4437-8788-9dd93b20f7a1', 'a16df79d-e028-4fc4-8bca-4c66a91b9ffe', '75ea7e8f-6d79-4440-a55a-142397da6eb3'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 16:00:59 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-1011fc14-0a9b-4c92-8fc3-9b3d071f5ef0 tempest-CreateVolumesFromSnapshotTest-289507390 None] Delete snapshot completed successfully. Apr 25 16:00:59 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-1011fc14-0a9b-4c92-8fc3-9b3d071f5ef0 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "cinder-5fd16a0f-16bb-4ce5-b48b-aba9549fc148-delete_snapshot" released by "delete_snapshot" :: held 3.250s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:00 devstack cinder-volume[81828]: DEBUG oslo_service.periodic_task [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=81828) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 25 16:01:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:01:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:01:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:01:00 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:01:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:01:00 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:00 devstack sudo[91186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 16:01:00 devstack sudo[91186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:00 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fe4d26d4-4922-458e-b00f-a8d5a3166647 tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "cinder-81b299f6-b05a-4c7e-9b91-b4ab7cc21901-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:00 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fe4d26d4-4922-458e-b00f-a8d5a3166647 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "cinder-81b299f6-b05a-4c7e-9b91-b4ab7cc21901-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:01 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fe4d26d4-4922-458e-b00f-a8d5a3166647 tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "cinder-quobyte-81b299f6-b05a-4c7e-9b91-b4ab7cc21901" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:01 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fe4d26d4-4922-458e-b00f-a8d5a3166647 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "cinder-quobyte-81b299f6-b05a-4c7e-9b91-b4ab7cc21901" acquired by "delete_volume" :: waited 0.018s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:01 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc627b63-aa61-4d84-8f20-d1fb6f82a210]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:01:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fe4d26d4-4922-458e-b00f-a8d5a3166647 tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:01 devstack sudo[91186]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:01 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.925s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:01 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-1707a0b1-08d3-4592-b881-d13508f82282 None None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 16:01:01 devstack sudo[91189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901 Apr 25 16:01:01 devstack sudo[91189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:02 devstack sudo[91189]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fe4d26d4-4922-458e-b00f-a8d5a3166647 tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901" returned: 0 in 1.210s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fe4d26d4-4922-458e-b00f-a8d5a3166647 tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:02 devstack sudo[91195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901 Apr 25 16:01:02 devstack sudo[91195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:02 devstack sudo[91163]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee" returned: 0 in 4.913s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:02 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af284c3-14f3-4b3b-8296-b0f79562226f]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:01:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:02 devstack sudo[91197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0 Apr 25 16:01:02 devstack sudo[91197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:02 devstack sudo[91195]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fe4d26d4-4922-458e-b00f-a8d5a3166647 tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-81b299f6-b05a-4c7e-9b91-b4ab7cc21901" returned: 0 in 0.434s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:02 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fe4d26d4-4922-458e-b00f-a8d5a3166647 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "cinder-quobyte-81b299f6-b05a-4c7e-9b91-b4ab7cc21901" released by "delete_volume" :: held 1.798s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:02 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-fe4d26d4-4922-458e-b00f-a8d5a3166647 tempest-CreateVolumesFromSnapshotTest-289507390 None] Created reservations ['f626b7ce-9db1-48ed-8a24-d4ac9518056f', '3d0de613-42cd-4a34-b5d8-0c659645d78e', 'c23f279f-4fe0-42d2-afff-3b08d130adba', '623cdb0d-c5fe-45db-86e5-5479ce8ea845'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 16:01:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fe4d26d4-4922-458e-b00f-a8d5a3166647 tempest-CreateVolumesFromSnapshotTest-289507390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:01:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fe4d26d4-4922-458e-b00f-a8d5a3166647 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:01:02 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-fe4d26d4-4922-458e-b00f-a8d5a3166647 tempest-CreateVolumesFromSnapshotTest-289507390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:01:02 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-fe4d26d4-4922-458e-b00f-a8d5a3166647 tempest-CreateVolumesFromSnapshotTest-289507390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:01:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fe4d26d4-4922-458e-b00f-a8d5a3166647 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:01:02 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fe4d26d4-4922-458e-b00f-a8d5a3166647 tempest-CreateVolumesFromSnapshotTest-289507390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:02 devstack sudo[91202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 16:01:02 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:03 devstack sudo[91197]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0" returned: 0 in 0.654s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:03 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Image conversion details: src /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0, size 1024.00 MB, duration 4.91 sec, destination /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee {{(pid=81828) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 16:01:03 devstack cinder-volume[81828]: INFO cinder.image.image_utils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Converted 1024.00 MB image at 208.37 MB/s Apr 25 16:01:03 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee is being set with open permissions: ugo+rw Apr 25 16:01:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:03 devstack sudo[91205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee Apr 25 16:01:03 devstack sudo[91205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:03 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fe4d26d4-4922-458e-b00f-a8d5a3166647 tempest-CreateVolumesFromSnapshotTest-289507390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.500s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:03 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-fe4d26d4-4922-458e-b00f-a8d5a3166647 tempest-CreateVolumesFromSnapshotTest-289507390 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 16:01:03 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-fe4d26d4-4922-458e-b00f-a8d5a3166647 tempest-CreateVolumesFromSnapshotTest-289507390 None] Deleted volume successfully. Apr 25 16:01:03 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fe4d26d4-4922-458e-b00f-a8d5a3166647 tempest-CreateVolumesFromSnapshotTest-289507390 None] Lock "cinder-81b299f6-b05a-4c7e-9b91-b4ab7cc21901-delete_volume" released by "delete_volume" :: held 2.557s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:03 devstack sudo[91205]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee" returned: 0 in 0.539s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:03 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Lock "cinder-quobyte-c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee" released by "_copy_volume_from_snapshot" :: held 7.280s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:03 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Acquiring lock "cinder-quobyte-a52280c6-d8f6-49e6-90b2-e0ef6e94e598" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:03 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Lock "cinder-quobyte-a52280c6-d8f6-49e6-90b2-e0ef6e94e598" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:03 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Deleting offline snapshot a52280c6-d8f6-49e6-90b2-e0ef6e94e598 of volume 98e75589-d72c-4015-8be9-506731f22af0 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 16:01:03 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] snapshot_file for this snap is: volume-98e75589-d72c-4015-8be9-506731f22af0.a52280c6-d8f6-49e6-90b2-e0ef6e94e598 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 16:01:03 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f300a2c-cce1-41f9-b686-6fe7192c3610]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:01:03 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0.a52280c6-d8f6-49e6-90b2-e0ef6e94e598 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:03 devstack sudo[91209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0.a52280c6-d8f6-49e6-90b2-e0ef6e94e598 Apr 25 16:01:03 devstack sudo[91209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:04 devstack sudo[91209]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0.a52280c6-d8f6-49e6-90b2-e0ef6e94e598" returned: 0 in 0.631s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:04 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98e75589-d72c-4015-8be9-506731f22af0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 16:01:04 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[217d56cc-4ebb-4a41-bb9c-70f18e5a6c8a]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:01:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:04 devstack sudo[91214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0 Apr 25 16:01:04 devstack sudo[91214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:04 devstack sudo[91214]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0" returned: 0 in 0.531s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:04 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0.a52280c6-d8f6-49e6-90b2-e0ef6e94e598 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:04 devstack sudo[91219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0.a52280c6-d8f6-49e6-90b2-e0ef6e94e598 Apr 25 16:01:04 devstack sudo[91219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:05 devstack sudo[91219]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0.a52280c6-d8f6-49e6-90b2-e0ef6e94e598" returned: 0 in 0.640s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0.a52280c6-d8f6-49e6-90b2-e0ef6e94e598 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:05 devstack sudo[91224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0.a52280c6-d8f6-49e6-90b2-e0ef6e94e598 Apr 25 16:01:05 devstack sudo[91224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:05 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 16:01:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Flow 'volume_create_manager' (3172d639-23b6-45fb-8a6d-55549f359d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:01:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a2696a-2370-421b-ac23-060d1ab44184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a2696a-2370-421b-ac23-060d1ab44184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2087607717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a120cde-7ff5-4a3c-9402-52586085bb9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cef904e045a4b159f702e188e188d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:01:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:01:06Z,use_quota=True,user_id='c5f1873eb1ee467fb827c8712a23cde7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67289c95-3eb6-42e2-ae6d-583aa560ae3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67289c95-3eb6-42e2-ae6d-583aa560ae3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dc626c1-4ff0-43e5-8b12-b5528ac69b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dc626c1-4ff0-43e5-8b12-b5528ac69b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a120cde-7ff5-4a3c-9402-52586085bb9f', 'volume_name': 'volume-0a120cde-7ff5-4a3c-9402-52586085bb9f', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eabed4bf-d3ab-47fe-a551-478f993c3451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eabed4bf-d3ab-47fe-a551-478f993c3451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:05 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada84cf3-e011-4d87-a6b9-c9e75e5fa65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:05 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Volume 0a120cde-7ff5-4a3c-9402-52586085bb9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a120cde-7ff5-4a3c-9402-52586085bb9f', 'volume_size': 1} Apr 25 16:01:05 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:01:06 devstack sudo[91224]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0.a52280c6-d8f6-49e6-90b2-e0ef6e94e598" returned: 0 in 0.450s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Lock "cinder-quobyte-a52280c6-d8f6-49e6-90b2-e0ef6e94e598" released by "_delete_snapshot" :: held 2.345s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.015s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 13.503s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Acquiring lock "cinder-quobyte-f9d12a44-b28b-43f5-bf21-e2601cdcd763-633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae" by "_create_volume_from_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720dc7ea-f0fc-4934-a1bb-f4f65d9359b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee', 'volume_size': 1, 'source_volid': '98e75589-d72c-4015-8be9-506731f22af0', 'source_volstatus': 'available'}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d64e19-2ae6-46e9-a1f7-9d5803c07893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Lock "cinder-quobyte-f9d12a44-b28b-43f5-bf21-e2601cdcd763-633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Creating volume 633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae from snapshot f9d12a44-b28b-43f5-bf21-e2601cdcd763 {{(pid=81828) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Acquiring lock "cinder-quobyte-633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae" by "_copy_volume_from_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:06 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Volume volume-c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee (c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee): created successfully Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d64e19-2ae6-46e9-a1f7-9d5803c07893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Flow 'volume_create_manager' (56936bc4-2004-41fa-96f5-e0011c045728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Lock "cinder-quobyte-633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] snapshot: f9d12a44-b28b-43f5-bf21-e2601cdcd763, volume: 633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae, {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:01:06 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-793163c0-437d-413a-b35e-ccf1e3012c70 tempest-VolumeDependencyTests-1097684438 None] Created volume successfully. Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a5727a-0b9b-4439-b821-4437c81a8de8]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a.f9d12a44-b28b-43f5-bf21-e2601cdcd763 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:06 devstack sudo[91227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a.f9d12a44-b28b-43f5-bf21-e2601cdcd763 Apr 25 16:01:06 devstack sudo[91227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d31df4b7-dec0-4eb3-9a55-746d00849e81 tempest-VolumeDependencyTests-1097684438 None] Acquiring lock "cinder-98e75589-d72c-4015-8be9-506731f22af0-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d31df4b7-dec0-4eb3-9a55-746d00849e81 tempest-VolumeDependencyTests-1097684438 None] Lock "cinder-98e75589-d72c-4015-8be9-506731f22af0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d31df4b7-dec0-4eb3-9a55-746d00849e81 tempest-VolumeDependencyTests-1097684438 None] Acquiring lock "cinder-quobyte-98e75589-d72c-4015-8be9-506731f22af0" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d31df4b7-dec0-4eb3-9a55-746d00849e81 tempest-VolumeDependencyTests-1097684438 None] Lock "cinder-quobyte-98e75589-d72c-4015-8be9-506731f22af0" acquired by "delete_volume" :: waited 0.016s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[971d5ea7-64c1-4956-913a-e1b63862cc6f]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d31df4b7-dec0-4eb3-9a55-746d00849e81 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:06 devstack sudo[91227]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a.f9d12a44-b28b-43f5-bf21-e2601cdcd763" returned: 0 in 0.556s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] will copy from snapshot at /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Creating direct copy from snapshot {{(pid=81828) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bf97c6-87ef-4f7f-a8f4-167ef0515eef]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:01:06 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:06 devstack sudo[91232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0 Apr 25 16:01:06 devstack sudo[91232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:06 devstack sudo[91233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a Apr 25 16:01:06 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:07 devstack sudo[91232]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d31df4b7-dec0-4eb3-9a55-746d00849e81 tempest-VolumeDependencyTests-1097684438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0" returned: 0 in 0.532s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d31df4b7-dec0-4eb3-9a55-746d00849e81 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:07 devstack sudo[91242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0 Apr 25 16:01:07 devstack sudo[91242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:07 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a" returned: 0 in 0.513s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:07 devstack cinder-volume[81828]: DEBUG cinder.utils [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Path /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae not found in is_blk_device check {{(pid=81828) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 25 16:01:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:07 devstack sudo[91244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae Apr 25 16:01:07 devstack sudo[91244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:07 devstack sudo[91242]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d31df4b7-dec0-4eb3-9a55-746d00849e81 tempest-VolumeDependencyTests-1097684438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-98e75589-d72c-4015-8be9-506731f22af0" returned: 0 in 0.474s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:07 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d31df4b7-dec0-4eb3-9a55-746d00849e81 tempest-VolumeDependencyTests-1097684438 None] Lock "cinder-quobyte-98e75589-d72c-4015-8be9-506731f22af0" released by "delete_volume" :: held 1.064s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:07 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-d31df4b7-dec0-4eb3-9a55-746d00849e81 tempest-VolumeDependencyTests-1097684438 None] Created reservations ['65d221d2-6955-408a-ae5f-e0bb80571f08', '4a3d1a6c-5559-4db9-badc-71acd7e5208b', 'a512d13d-59fd-4d6f-9047-343dd5e2f96b', 'bfc00069-cf31-45e6-b5f4-4dce2263183c'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 16:01:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d31df4b7-dec0-4eb3-9a55-746d00849e81 tempest-VolumeDependencyTests-1097684438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:01:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d31df4b7-dec0-4eb3-9a55-746d00849e81 tempest-VolumeDependencyTests-1097684438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:01:07 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d31df4b7-dec0-4eb3-9a55-746d00849e81 tempest-VolumeDependencyTests-1097684438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:01:07 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d31df4b7-dec0-4eb3-9a55-746d00849e81 tempest-VolumeDependencyTests-1097684438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:01:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d31df4b7-dec0-4eb3-9a55-746d00849e81 tempest-VolumeDependencyTests-1097684438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:01:07 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d31df4b7-dec0-4eb3-9a55-746d00849e81 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:07 devstack sudo[91250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 16:01:07 devstack sudo[91250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:08 devstack sudo[91250]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:08 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d31df4b7-dec0-4eb3-9a55-746d00849e81 tempest-VolumeDependencyTests-1097684438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.730s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:08 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-d31df4b7-dec0-4eb3-9a55-746d00849e81 tempest-VolumeDependencyTests-1097684438 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 16:01:08 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-d31df4b7-dec0-4eb3-9a55-746d00849e81 tempest-VolumeDependencyTests-1097684438 None] Deleted volume successfully. Apr 25 16:01:08 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d31df4b7-dec0-4eb3-9a55-746d00849e81 tempest-VolumeDependencyTests-1097684438 None] Lock "cinder-98e75589-d72c-4015-8be9-506731f22af0-delete_volume" released by "delete_volume" :: held 2.031s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:08 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3cd3b85d-f1b0-4373-bc50-1c1cdcf90e59 tempest-VolumeDependencyTests-1097684438 None] Acquiring lock "cinder-c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:08 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3cd3b85d-f1b0-4373-bc50-1c1cdcf90e59 tempest-VolumeDependencyTests-1097684438 None] Lock "cinder-c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:09 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3cd3b85d-f1b0-4373-bc50-1c1cdcf90e59 tempest-VolumeDependencyTests-1097684438 None] Acquiring lock "cinder-quobyte-c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:09 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3cd3b85d-f1b0-4373-bc50-1c1cdcf90e59 tempest-VolumeDependencyTests-1097684438 None] Lock "cinder-quobyte-c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee" acquired by "delete_volume" :: waited 0.023s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:09 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6540f98-fd0c-433c-af9a-6b4d4b4ba958]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:01:09 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3cd3b85d-f1b0-4373-bc50-1c1cdcf90e59 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:09 devstack sudo[91260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee Apr 25 16:01:09 devstack sudo[91260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:10 devstack sudo[91260]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3cd3b85d-f1b0-4373-bc50-1c1cdcf90e59 tempest-VolumeDependencyTests-1097684438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee" returned: 0 in 1.283s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:10 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3cd3b85d-f1b0-4373-bc50-1c1cdcf90e59 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:10 devstack sudo[91265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee Apr 25 16:01:10 devstack sudo[91265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:11 devstack sudo[91265]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3cd3b85d-f1b0-4373-bc50-1c1cdcf90e59 tempest-VolumeDependencyTests-1097684438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee" returned: 0 in 0.936s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:11 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3cd3b85d-f1b0-4373-bc50-1c1cdcf90e59 tempest-VolumeDependencyTests-1097684438 None] Lock "cinder-quobyte-c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee" released by "delete_volume" :: held 2.322s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:11 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-3cd3b85d-f1b0-4373-bc50-1c1cdcf90e59 tempest-VolumeDependencyTests-1097684438 None] Created reservations ['818077a1-ae1e-430f-8088-88bb3ebc7d88', '17cf265f-4a75-4a1b-bd45-2e92ca815c25', 'ffa322d3-089d-4a3f-90d9-d62ae68e3c8f', 'cc939de1-c8e6-420e-88b3-a4168d2d36da'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 16:01:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3cd3b85d-f1b0-4373-bc50-1c1cdcf90e59 tempest-VolumeDependencyTests-1097684438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:01:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3cd3b85d-f1b0-4373-bc50-1c1cdcf90e59 tempest-VolumeDependencyTests-1097684438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:01:11 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3cd3b85d-f1b0-4373-bc50-1c1cdcf90e59 tempest-VolumeDependencyTests-1097684438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:01:11 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-3cd3b85d-f1b0-4373-bc50-1c1cdcf90e59 tempest-VolumeDependencyTests-1097684438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:01:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-3cd3b85d-f1b0-4373-bc50-1c1cdcf90e59 tempest-VolumeDependencyTests-1097684438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:01:11 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3cd3b85d-f1b0-4373-bc50-1c1cdcf90e59 tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:11 devstack sudo[91269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 16:01:11 devstack sudo[91269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:12 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b7c968e9-f6cf-4bb5-8410-e7d0a3566efd tempest-VolumeDependencyTests-1097684438 None] Acquiring lock "cinder-7b63c6eb-1ba0-4438-bfb0-9974a4cdb625-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:12 devstack sudo[91244]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae" returned: 0 in 5.145s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:12 devstack sudo[91269]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:12 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b7c968e9-f6cf-4bb5-8410-e7d0a3566efd tempest-VolumeDependencyTests-1097684438 None] Lock "cinder-7b63c6eb-1ba0-4438-bfb0-9974a4cdb625-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:12 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ab9de6-4e7b-44a2-80db-578903a29852]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:01:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-3cd3b85d-f1b0-4373-bc50-1c1cdcf90e59 tempest-VolumeDependencyTests-1097684438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.914s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:12 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-3cd3b85d-f1b0-4373-bc50-1c1cdcf90e59 tempest-VolumeDependencyTests-1097684438 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 16:01:12 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-3cd3b85d-f1b0-4373-bc50-1c1cdcf90e59 tempest-VolumeDependencyTests-1097684438 None] Deleted volume successfully. Apr 25 16:01:12 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b7c968e9-f6cf-4bb5-8410-e7d0a3566efd tempest-VolumeDependencyTests-1097684438 None] Acquiring lock "cinder-quobyte-7b63c6eb-1ba0-4438-bfb0-9974a4cdb625" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:12 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-3cd3b85d-f1b0-4373-bc50-1c1cdcf90e59 tempest-VolumeDependencyTests-1097684438 None] Lock "cinder-c4c70bbd-8d10-46e9-8c3a-ad20ff0010ee-delete_volume" released by "delete_volume" :: held 3.613s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:12 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b7c968e9-f6cf-4bb5-8410-e7d0a3566efd tempest-VolumeDependencyTests-1097684438 None] Lock "cinder-quobyte-7b63c6eb-1ba0-4438-bfb0-9974a4cdb625" acquired by "delete_volume" :: waited 0.015s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:12 devstack sudo[91272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a Apr 25 16:01:12 devstack sudo[91272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:12 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bca351a-4b50-4550-a0bf-3784e6a90ed0]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:01:12 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b7c968e9-f6cf-4bb5-8410-e7d0a3566efd tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7b63c6eb-1ba0-4438-bfb0-9974a4cdb625 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:12 devstack sudo[91274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7b63c6eb-1ba0-4438-bfb0-9974a4cdb625 Apr 25 16:01:12 devstack sudo[91274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:13 devstack sudo[91274]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b7c968e9-f6cf-4bb5-8410-e7d0a3566efd tempest-VolumeDependencyTests-1097684438 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7b63c6eb-1ba0-4438-bfb0-9974a4cdb625" returned: 0 in 0.526s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b7c968e9-f6cf-4bb5-8410-e7d0a3566efd tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7b63c6eb-1ba0-4438-bfb0-9974a4cdb625 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:13 devstack sudo[91282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7b63c6eb-1ba0-4438-bfb0-9974a4cdb625 Apr 25 16:01:13 devstack sudo[91282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:13 devstack sudo[91272]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a" returned: 0 in 0.657s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:13 devstack cinder-volume[81828]: DEBUG cinder.image.image_utils [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Image conversion details: src /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a, size 1024.00 MB, duration 5.15 sec, destination /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae {{(pid=81828) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 25 16:01:13 devstack cinder-volume[81828]: INFO cinder.image.image_utils [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Converted 1024.00 MB image at 198.98 MB/s Apr 25 16:01:13 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae is being set with open permissions: ugo+rw Apr 25 16:01:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:13 devstack sudo[91284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae Apr 25 16:01:13 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:13 devstack sudo[91282]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b7c968e9-f6cf-4bb5-8410-e7d0a3566efd tempest-VolumeDependencyTests-1097684438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-7b63c6eb-1ba0-4438-bfb0-9974a4cdb625" returned: 0 in 0.479s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:13 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b7c968e9-f6cf-4bb5-8410-e7d0a3566efd tempest-VolumeDependencyTests-1097684438 None] Lock "cinder-quobyte-7b63c6eb-1ba0-4438-bfb0-9974a4cdb625" released by "delete_volume" :: held 1.045s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:13 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae" returned: 0 in 0.494s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:13 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Lock "cinder-quobyte-633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae" released by "_copy_volume_from_snapshot" :: held 7.470s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:13 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Lock "cinder-quobyte-f9d12a44-b28b-43f5-bf21-e2601cdcd763-633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae" released by "_create_volume_from_snapshot" :: held 7.515s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.553s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:01:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-22d72e36-fb56-4c74-ace9-81d287da3133 tempest-CinderUnicodeTest-593846682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 19.387s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:01:13 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-22d72e36-fb56-4c74-ace9-81d287da3133 tempest-CinderUnicodeTest-593846682 None] Creating offline snapshot 2a546641-469e-4afe-a4b3-6d36de310aff of volume b7736c4f-4b5d-4747-a3d6-2406c584d890 {{(pid=81828) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Apr 25 16:01:13 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-b7c968e9-f6cf-4bb5-8410-e7d0a3566efd tempest-VolumeDependencyTests-1097684438 None] Created reservations ['e96c0f8b-76f4-45ed-be54-f510ba67fbed', 'e08cfa32-d486-4ff8-a60b-67d220c29acf', 'f00c25d1-65c7-448e-8251-bec1ae5387e6', '40b3cce4-b81f-4ae7-a3f2-b18b8d35bec3'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 16:01:13 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[6886e41b-1b4e-4448-af45-0e9e0b5e9802]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:01:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22d72e36-fb56-4c74-ace9-81d287da3133 tempest-CinderUnicodeTest-593846682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91ed9e8d-bbc5-481c-b1e9-8f323fe83238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae', 'volume_size': 1, 'snapshot_id': 'f9d12a44-b28b-43f5-bf21-e2601cdcd763'}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4464dfc-494d-48ce-b7d6-0fc8d7b5c828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:13 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Volume volume-633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae (633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae): created successfully Apr 25 16:01:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4464dfc-494d-48ce-b7d6-0fc8d7b5c828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:13 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Flow 'volume_create_manager' (e9570671-5319-4a30-9233-23eb17cebb0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:01:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b7c968e9-f6cf-4bb5-8410-e7d0a3566efd tempest-VolumeDependencyTests-1097684438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:01:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b7c968e9-f6cf-4bb5-8410-e7d0a3566efd tempest-VolumeDependencyTests-1097684438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:01:13 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b7c968e9-f6cf-4bb5-8410-e7d0a3566efd tempest-VolumeDependencyTests-1097684438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:01:13 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-b7c968e9-f6cf-4bb5-8410-e7d0a3566efd tempest-VolumeDependencyTests-1097684438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:01:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-b7c968e9-f6cf-4bb5-8410-e7d0a3566efd tempest-VolumeDependencyTests-1097684438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:01:13 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b7c968e9-f6cf-4bb5-8410-e7d0a3566efd tempest-VolumeDependencyTests-1097684438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:13 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-fcc86836-2866-4605-9f6e-6c41480ff300 tempest-SnapshotDependencyTests-30070103 None] Created volume successfully. Apr 25 16:01:13 devstack sudo[91320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890 Apr 25 16:01:13 devstack sudo[91320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:13 devstack sudo[91323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 16:01:13 devstack sudo[91323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:14 devstack sudo[91320]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22d72e36-fb56-4c74-ace9-81d287da3133 tempest-CinderUnicodeTest-593846682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890" returned: 0 in 0.574s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22d72e36-fb56-4c74-ace9-81d287da3133 tempest-CinderUnicodeTest-593846682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890.2a546641-469e-4afe-a4b3-6d36de310aff 1G {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:14 devstack sudo[91323]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-b7c968e9-f6cf-4bb5-8410-e7d0a3566efd tempest-VolumeDependencyTests-1097684438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.494s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:14 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-b7c968e9-f6cf-4bb5-8410-e7d0a3566efd tempest-VolumeDependencyTests-1097684438 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 16:01:14 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-b7c968e9-f6cf-4bb5-8410-e7d0a3566efd tempest-VolumeDependencyTests-1097684438 None] Deleted volume successfully. Apr 25 16:01:14 devstack sudo[91330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890.2a546641-469e-4afe-a4b3-6d36de310aff 1G Apr 25 16:01:14 devstack sudo[91330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:14 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-b7c968e9-f6cf-4bb5-8410-e7d0a3566efd tempest-VolumeDependencyTests-1097684438 None] Lock "cinder-7b63c6eb-1ba0-4438-bfb0-9974a4cdb625-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:14 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f3b553f2-3f35-4e4a-8deb-dd10af816b1e tempest-SnapshotDependencyTests-30070103 None] Acquiring lock "cinder-f9d12a44-b28b-43f5-bf21-e2601cdcd763-delete_snapshot" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:14 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f3b553f2-3f35-4e4a-8deb-dd10af816b1e tempest-SnapshotDependencyTests-30070103 None] Lock "cinder-f9d12a44-b28b-43f5-bf21-e2601cdcd763-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:14 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f3b553f2-3f35-4e4a-8deb-dd10af816b1e tempest-SnapshotDependencyTests-30070103 None] Acquiring lock "cinder-quobyte-5bdea943-0c2c-45a4-b545-4ad3ae96084a" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:14 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f3b553f2-3f35-4e4a-8deb-dd10af816b1e tempest-SnapshotDependencyTests-30070103 None] Lock "cinder-quobyte-5bdea943-0c2c-45a4-b545-4ad3ae96084a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:14 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f3b553f2-3f35-4e4a-8deb-dd10af816b1e tempest-SnapshotDependencyTests-30070103 None] Acquiring lock "cinder-quobyte-f9d12a44-b28b-43f5-bf21-e2601cdcd763" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:14 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f3b553f2-3f35-4e4a-8deb-dd10af816b1e tempest-SnapshotDependencyTests-30070103 None] Lock "cinder-quobyte-f9d12a44-b28b-43f5-bf21-e2601cdcd763" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:14 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-f3b553f2-3f35-4e4a-8deb-dd10af816b1e tempest-SnapshotDependencyTests-30070103 None] Deleting offline snapshot f9d12a44-b28b-43f5-bf21-e2601cdcd763 of volume 5bdea943-0c2c-45a4-b545-4ad3ae96084a {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 16:01:14 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-f3b553f2-3f35-4e4a-8deb-dd10af816b1e tempest-SnapshotDependencyTests-30070103 None] snapshot_file for this snap is: volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a.f9d12a44-b28b-43f5-bf21-e2601cdcd763 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 16:01:14 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[47070b1c-02f5-4b0e-aa2c-b635a8e2a8a6]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:01:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f3b553f2-3f35-4e4a-8deb-dd10af816b1e tempest-SnapshotDependencyTests-30070103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a.f9d12a44-b28b-43f5-bf21-e2601cdcd763 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:14 devstack sudo[91332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a.f9d12a44-b28b-43f5-bf21-e2601cdcd763 Apr 25 16:01:14 devstack sudo[91332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:14 devstack sudo[91330]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22d72e36-fb56-4c74-ace9-81d287da3133 tempest-CinderUnicodeTest-593846682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890.2a546641-469e-4afe-a4b3-6d36de310aff 1G" returned: 0 in 0.694s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:14 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22d72e36-fb56-4c74-ace9-81d287da3133 tempest-CinderUnicodeTest-593846682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7736c4f-4b5d-4747-a3d6-2406c584d890 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890.2a546641-469e-4afe-a4b3-6d36de310aff {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:15 devstack sudo[91340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7736c4f-4b5d-4747-a3d6-2406c584d890 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890.2a546641-469e-4afe-a4b3-6d36de310aff Apr 25 16:01:15 devstack sudo[91340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:15 devstack sudo[91332]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f3b553f2-3f35-4e4a-8deb-dd10af816b1e tempest-SnapshotDependencyTests-30070103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a.f9d12a44-b28b-43f5-bf21-e2601cdcd763" returned: 0 in 0.567s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:15 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-f3b553f2-3f35-4e4a-8deb-dd10af816b1e tempest-SnapshotDependencyTests-30070103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 16:01:15 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[8099a649-5241-4f02-b61b-a1c0548e3d4b]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:01:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f3b553f2-3f35-4e4a-8deb-dd10af816b1e tempest-SnapshotDependencyTests-30070103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:15 devstack sudo[91342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a Apr 25 16:01:15 devstack sudo[91342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:15 devstack sudo[91340]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22d72e36-fb56-4c74-ace9-81d287da3133 tempest-CinderUnicodeTest-593846682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7736c4f-4b5d-4747-a3d6-2406c584d890 -F qcow2 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890.2a546641-469e-4afe-a4b3-6d36de310aff" returned: 0 in 0.649s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:15 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-22d72e36-fb56-4c74-ace9-81d287da3133 tempest-CinderUnicodeTest-593846682 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890.2a546641-469e-4afe-a4b3-6d36de310aff is being set with open permissions: ugo+rw Apr 25 16:01:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22d72e36-fb56-4c74-ace9-81d287da3133 tempest-CinderUnicodeTest-593846682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890.2a546641-469e-4afe-a4b3-6d36de310aff {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:15 devstack sudo[91351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890.2a546641-469e-4afe-a4b3-6d36de310aff Apr 25 16:01:15 devstack sudo[91351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:15 devstack sudo[91342]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f3b553f2-3f35-4e4a-8deb-dd10af816b1e tempest-SnapshotDependencyTests-30070103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a" returned: 0 in 0.621s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:15 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f3b553f2-3f35-4e4a-8deb-dd10af816b1e tempest-SnapshotDependencyTests-30070103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a.f9d12a44-b28b-43f5-bf21-e2601cdcd763 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:15 devstack sudo[91353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a.f9d12a44-b28b-43f5-bf21-e2601cdcd763 Apr 25 16:01:15 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:16 devstack sudo[91351]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22d72e36-fb56-4c74-ace9-81d287da3133 tempest-CinderUnicodeTest-593846682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890.2a546641-469e-4afe-a4b3-6d36de310aff" returned: 0 in 0.515s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22d72e36-fb56-4c74-ace9-81d287da3133 tempest-CinderUnicodeTest-593846682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:16 devstack sudo[91359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890.info Apr 25 16:01:16 devstack sudo[91359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:16 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f3b553f2-3f35-4e4a-8deb-dd10af816b1e tempest-SnapshotDependencyTests-30070103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a.f9d12a44-b28b-43f5-bf21-e2601cdcd763" returned: 0 in 0.585s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f3b553f2-3f35-4e4a-8deb-dd10af816b1e tempest-SnapshotDependencyTests-30070103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a.f9d12a44-b28b-43f5-bf21-e2601cdcd763 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:16 devstack sudo[91361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a.f9d12a44-b28b-43f5-bf21-e2601cdcd763 Apr 25 16:01:16 devstack sudo[91361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:16 devstack sudo[91359]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22d72e36-fb56-4c74-ace9-81d287da3133 tempest-CinderUnicodeTest-593846682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890.info" returned: 0 in 0.478s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:16 devstack cinder-volume[81828]: WARNING cinder.volume.drivers.remotefs [None req-22d72e36-fb56-4c74-ace9-81d287da3133 tempest-CinderUnicodeTest-593846682 None] /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890.info is being set with open permissions: ugo+rw Apr 25 16:01:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22d72e36-fb56-4c74-ace9-81d287da3133 tempest-CinderUnicodeTest-593846682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890.info {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:16 devstack sudo[91364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890.info Apr 25 16:01:16 devstack sudo[91364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:16 devstack sudo[91361]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:16 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f3b553f2-3f35-4e4a-8deb-dd10af816b1e tempest-SnapshotDependencyTests-30070103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a.f9d12a44-b28b-43f5-bf21-e2601cdcd763" returned: 0 in 0.545s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:16 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f3b553f2-3f35-4e4a-8deb-dd10af816b1e tempest-SnapshotDependencyTests-30070103 None] Lock "cinder-quobyte-f9d12a44-b28b-43f5-bf21-e2601cdcd763" released by "_delete_snapshot" :: held 2.427s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:16 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f3b553f2-3f35-4e4a-8deb-dd10af816b1e tempest-SnapshotDependencyTests-30070103 None] Lock "cinder-quobyte-5bdea943-0c2c-45a4-b545-4ad3ae96084a" released by "delete_snapshot" :: held 2.467s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:16 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-f3b553f2-3f35-4e4a-8deb-dd10af816b1e tempest-SnapshotDependencyTests-30070103 None] Created reservations ['02883972-b419-4add-a4ce-6b5e1ae79e2f', '16b6277a-12bc-4e30-9afb-6ac1dc7cbfb2', '92f12226-c74b-408a-b0da-8fbd38449401', '1102f4b4-f38f-4cc1-9edd-12a804419725'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 16:01:17 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-f3b553f2-3f35-4e4a-8deb-dd10af816b1e tempest-SnapshotDependencyTests-30070103 None] Delete snapshot completed successfully. Apr 25 16:01:17 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f3b553f2-3f35-4e4a-8deb-dd10af816b1e tempest-SnapshotDependencyTests-30070103 None] Lock "cinder-f9d12a44-b28b-43f5-bf21-e2601cdcd763-delete_snapshot" released by "delete_snapshot" :: held 2.620s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:17 devstack sudo[91364]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22d72e36-fb56-4c74-ace9-81d287da3133 tempest-CinderUnicodeTest-593846682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890.info" returned: 0 in 0.470s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-22d72e36-fb56-4c74-ace9-81d287da3133 tempest-CinderUnicodeTest-593846682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.489s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:01:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.406s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:01:17 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:01:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2087607717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a120cde-7ff5-4a3c-9402-52586085bb9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cef904e045a4b159f702e188e188d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:01:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:01:06Z,use_quota=True,user_id='c5f1873eb1ee467fb827c8712a23cde7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 16:01:17 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Creating volume 0a120cde-7ff5-4a3c-9402-52586085bb9f {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 16:01:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:01:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:01:17 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:01:17 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:01:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:01:17 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 16:01:17 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 16:01:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0a120cde-7ff5-4a3c-9402-52586085bb9f 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:17 devstack sudo[91368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0a120cde-7ff5-4a3c-9402-52586085bb9f 1073741824 Apr 25 16:01:17 devstack sudo[91368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:17 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-22d72e36-fb56-4c74-ace9-81d287da3133 tempest-CinderUnicodeTest-593846682 None] Create snapshot completed successfully Apr 25 16:01:17 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-2c037f76-5c41-487c-84c8-6dc1796d8959 tempest-CinderUnicodeTest-593846682 None] Acquiring lock "cinder-2a546641-469e-4afe-a4b3-6d36de310aff-delete_snapshot" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:17 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-2c037f76-5c41-487c-84c8-6dc1796d8959 tempest-CinderUnicodeTest-593846682 None] Lock "cinder-2a546641-469e-4afe-a4b3-6d36de310aff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:17 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-2c037f76-5c41-487c-84c8-6dc1796d8959 tempest-CinderUnicodeTest-593846682 None] Acquiring lock "cinder-quobyte-b7736c4f-4b5d-4747-a3d6-2406c584d890" by "delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:17 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-2c037f76-5c41-487c-84c8-6dc1796d8959 tempest-CinderUnicodeTest-593846682 None] Lock "cinder-quobyte-b7736c4f-4b5d-4747-a3d6-2406c584d890" acquired by "delete_snapshot" :: waited 0.016s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:17 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-2c037f76-5c41-487c-84c8-6dc1796d8959 tempest-CinderUnicodeTest-593846682 None] Acquiring lock "cinder-quobyte-2a546641-469e-4afe-a4b3-6d36de310aff" by "_delete_snapshot" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:17 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-2c037f76-5c41-487c-84c8-6dc1796d8959 tempest-CinderUnicodeTest-593846682 None] Lock "cinder-quobyte-2a546641-469e-4afe-a4b3-6d36de310aff" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:17 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-2c037f76-5c41-487c-84c8-6dc1796d8959 tempest-CinderUnicodeTest-593846682 None] Deleting offline snapshot 2a546641-469e-4afe-a4b3-6d36de310aff of volume b7736c4f-4b5d-4747-a3d6-2406c584d890 {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 25 16:01:17 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-2c037f76-5c41-487c-84c8-6dc1796d8959 tempest-CinderUnicodeTest-593846682 None] snapshot_file for this snap is: volume-b7736c4f-4b5d-4747-a3d6-2406c584d890.2a546641-469e-4afe-a4b3-6d36de310aff {{(pid=81828) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 25 16:01:17 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a51d39c-2690-4ae0-a8d6-fc275e2c78d2]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:01:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2c037f76-5c41-487c-84c8-6dc1796d8959 tempest-CinderUnicodeTest-593846682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890.2a546641-469e-4afe-a4b3-6d36de310aff {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:17 devstack sudo[91370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890.2a546641-469e-4afe-a4b3-6d36de310aff Apr 25 16:01:17 devstack sudo[91370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:17 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c38e7aa6-17ec-4979-8c23-c83db576dc4c tempest-SnapshotDependencyTests-30070103 None] Acquiring lock "cinder-5bdea943-0c2c-45a4-b545-4ad3ae96084a-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:17 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c38e7aa6-17ec-4979-8c23-c83db576dc4c tempest-SnapshotDependencyTests-30070103 None] Lock "cinder-5bdea943-0c2c-45a4-b545-4ad3ae96084a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:17 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c38e7aa6-17ec-4979-8c23-c83db576dc4c tempest-SnapshotDependencyTests-30070103 None] Acquiring lock "cinder-quobyte-5bdea943-0c2c-45a4-b545-4ad3ae96084a" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:17 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c38e7aa6-17ec-4979-8c23-c83db576dc4c tempest-SnapshotDependencyTests-30070103 None] Lock "cinder-quobyte-5bdea943-0c2c-45a4-b545-4ad3ae96084a" acquired by "delete_volume" :: waited 0.020s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:17 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[704eb9e4-8c2b-4fc4-8ee1-3c55fd6cfd70]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:01:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c38e7aa6-17ec-4979-8c23-c83db576dc4c tempest-SnapshotDependencyTests-30070103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:17 devstack sudo[91375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a Apr 25 16:01:17 devstack sudo[91375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:17 devstack sudo[91368]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0a120cde-7ff5-4a3c-9402-52586085bb9f 1073741824" returned: 0 in 0.659s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:17 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0a120cde-7ff5-4a3c-9402-52586085bb9f {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:17 devstack sudo[91377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0a120cde-7ff5-4a3c-9402-52586085bb9f Apr 25 16:01:17 devstack sudo[91377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:18 devstack sudo[91370]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2c037f76-5c41-487c-84c8-6dc1796d8959 tempest-CinderUnicodeTest-593846682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890.2a546641-469e-4afe-a4b3-6d36de310aff" returned: 0 in 0.616s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:18 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-2c037f76-5c41-487c-84c8-6dc1796d8959 tempest-CinderUnicodeTest-593846682 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7736c4f-4b5d-4747-a3d6-2406c584d890(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=81828) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 25 16:01:18 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b259d6-e91f-4ec2-928a-6fe3cc028ed5]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:01:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2c037f76-5c41-487c-84c8-6dc1796d8959 tempest-CinderUnicodeTest-593846682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:18 devstack sudo[91382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890 Apr 25 16:01:18 devstack sudo[91382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:18 devstack sudo[91375]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c38e7aa6-17ec-4979-8c23-c83db576dc4c tempest-SnapshotDependencyTests-30070103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a" returned: 0 in 0.526s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c38e7aa6-17ec-4979-8c23-c83db576dc4c tempest-SnapshotDependencyTests-30070103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:18 devstack sudo[91388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a Apr 25 16:01:18 devstack sudo[91388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:18 devstack sudo[91377]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0a120cde-7ff5-4a3c-9402-52586085bb9f" returned: 0 in 0.455s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:18 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 16:01:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:01:18 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ada84cf3-e011-4d87-a6b9-c9e75e5fa65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a120cde-7ff5-4a3c-9402-52586085bb9f', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:18 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cc73978-b97a-46ac-a795-da66e471dba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:18 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Volume volume-0a120cde-7ff5-4a3c-9402-52586085bb9f (0a120cde-7ff5-4a3c-9402-52586085bb9f): created successfully Apr 25 16:01:18 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cc73978-b97a-46ac-a795-da66e471dba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:18 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Flow 'volume_create_manager' (3172d639-23b6-45fb-8a6d-55549f359d38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:01:18 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-6d8dd540-bd4b-42e7-a30f-7a2261d3468f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Created volume successfully. Apr 25 16:01:18 devstack sudo[91382]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2c037f76-5c41-487c-84c8-6dc1796d8959 tempest-CinderUnicodeTest-593846682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890" returned: 0 in 0.549s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2c037f76-5c41-487c-84c8-6dc1796d8959 tempest-CinderUnicodeTest-593846682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890.2a546641-469e-4afe-a4b3-6d36de310aff {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:18 devstack sudo[91394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890.2a546641-469e-4afe-a4b3-6d36de310aff Apr 25 16:01:18 devstack sudo[91394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:18 devstack sudo[91388]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c38e7aa6-17ec-4979-8c23-c83db576dc4c tempest-SnapshotDependencyTests-30070103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-5bdea943-0c2c-45a4-b545-4ad3ae96084a" returned: 0 in 0.478s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:18 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c38e7aa6-17ec-4979-8c23-c83db576dc4c tempest-SnapshotDependencyTests-30070103 None] Lock "cinder-quobyte-5bdea943-0c2c-45a4-b545-4ad3ae96084a" released by "delete_volume" :: held 1.068s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:18 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-c38e7aa6-17ec-4979-8c23-c83db576dc4c tempest-SnapshotDependencyTests-30070103 None] Created reservations ['6045bb61-9859-41df-a87d-2c60a3f75639', '1043e43e-21da-47b2-8280-b895744e2d07', 'bf1afe4a-dd22-4aff-9a35-1471458f43f8', '5b491db8-7e4a-441d-934d-12f3e1f91118'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 16:01:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c38e7aa6-17ec-4979-8c23-c83db576dc4c tempest-SnapshotDependencyTests-30070103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:01:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c38e7aa6-17ec-4979-8c23-c83db576dc4c tempest-SnapshotDependencyTests-30070103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:01:18 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c38e7aa6-17ec-4979-8c23-c83db576dc4c tempest-SnapshotDependencyTests-30070103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:01:18 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c38e7aa6-17ec-4979-8c23-c83db576dc4c tempest-SnapshotDependencyTests-30070103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:01:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c38e7aa6-17ec-4979-8c23-c83db576dc4c tempest-SnapshotDependencyTests-30070103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:01:18 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c38e7aa6-17ec-4979-8c23-c83db576dc4c tempest-SnapshotDependencyTests-30070103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:18 devstack sudo[91396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 16:01:18 devstack sudo[91396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Flow 'volume_create_manager' (6f456e02-1a4c-4e55-b1ef-07ad508cb8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f83c5a55-1852-4cd3-9977-6c5574921767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f83c5a55-1852-4cd3-9977-6c5574921767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1960647240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d80662-8825-4a28-8eea-3905cfe06edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cef904e045a4b159f702e188e188d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:01:19Z,use_quota=True,user_id='c5f1873eb1ee467fb827c8712a23cde7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5193f3cc-a1b9-4bc0-94cc-e7bf89a3b959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5193f3cc-a1b9-4bc0-94cc-e7bf89a3b959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba92b4dd-51de-4edf-9016-fe77f8ac9a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba92b4dd-51de-4edf-9016-fe77f8ac9a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28d80662-8825-4a28-8eea-3905cfe06edb', 'volume_name': 'volume-28d80662-8825-4a28-8eea-3905cfe06edb', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (512dd482-48b5-443a-8cfe-5365ecd116c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (512dd482-48b5-443a-8cfe-5365ecd116c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af22e62-9473-414c-88bc-377b172b6d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:19 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Volume 28d80662-8825-4a28-8eea-3905cfe06edb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28d80662-8825-4a28-8eea-3905cfe06edb', 'volume_size': 1} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1960647240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d80662-8825-4a28-8eea-3905cfe06edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cef904e045a4b159f702e188e188d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:01:19Z,use_quota=True,user_id='c5f1873eb1ee467fb827c8712a23cde7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Creating volume 28d80662-8825-4a28-8eea-3905cfe06edb {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 16:01:19 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-28d80662-8825-4a28-8eea-3905cfe06edb 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:19 devstack sudo[91401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-28d80662-8825-4a28-8eea-3905cfe06edb 1073741824 Apr 25 16:01:19 devstack sudo[91401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Flow 'volume_create_manager' (8e2b9424-a60c-421d-abaf-ce696b78b798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56cf5bb2-6766-432e-ad38-0a4a8d67ba72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56cf5bb2-6766-432e-ad38-0a4a8d67ba72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-876867972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b445f5e0-ca7c-4ee3-852d-0022d6213dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cef904e045a4b159f702e188e188d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:01:19Z,use_quota=True,user_id='c5f1873eb1ee467fb827c8712a23cde7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b6655e-2f1a-4a39-8ebb-ce4c32cae3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6b6655e-2f1a-4a39-8ebb-ce4c32cae3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:19 devstack sudo[91394]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c089742b-4fe0-476d-ad9b-2e11f0943664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c089742b-4fe0-476d-ad9b-2e11f0943664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b445f5e0-ca7c-4ee3-852d-0022d6213dae', 'volume_name': 'volume-b445f5e0-ca7c-4ee3-852d-0022d6213dae', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d752562d-545d-4bfa-9e21-02d79df8a37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d752562d-545d-4bfa-9e21-02d79df8a37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07adcf8-a8d3-4e4d-9825-af24c599f041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:19 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Volume b445f5e0-ca7c-4ee3-852d-0022d6213dae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b445f5e0-ca7c-4ee3-852d-0022d6213dae', 'volume_size': 1} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2c037f76-5c41-487c-84c8-6dc1796d8959 tempest-CinderUnicodeTest-593846682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890.2a546641-469e-4afe-a4b3-6d36de310aff" returned: 0 in 0.787s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2c037f76-5c41-487c-84c8-6dc1796d8959 tempest-CinderUnicodeTest-593846682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890.2a546641-469e-4afe-a4b3-6d36de310aff {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:19 devstack sudo[91404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890.2a546641-469e-4afe-a4b3-6d36de310aff Apr 25 16:01:19 devstack sudo[91404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:19 devstack sudo[91396]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c38e7aa6-17ec-4979-8c23-c83db576dc4c tempest-SnapshotDependencyTests-30070103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.696s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-c38e7aa6-17ec-4979-8c23-c83db576dc4c tempest-SnapshotDependencyTests-30070103 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 16:01:19 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-c38e7aa6-17ec-4979-8c23-c83db576dc4c tempest-SnapshotDependencyTests-30070103 None] Deleted volume successfully. Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-c38e7aa6-17ec-4979-8c23-c83db576dc4c tempest-SnapshotDependencyTests-30070103 None] Lock "cinder-5bdea943-0c2c-45a4-b545-4ad3ae96084a-delete_volume" released by "delete_volume" :: held 2.000s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Flow 'volume_create_manager' (9046383f-e968-4904-9f69-e85250fe2a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5115dfc-a437-47d4-b86e-e2a79b50f627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5115dfc-a437-47d4-b86e-e2a79b50f627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-273763406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3c07e63-b324-43b4-9793-c75a2c2cb7a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cef904e045a4b159f702e188e188d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:01:20Z,use_quota=True,user_id='c5f1873eb1ee467fb827c8712a23cde7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9280704-41f5-4e56-b15b-2079fc652319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9280704-41f5-4e56-b15b-2079fc652319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4abb9d9-148f-4a85-bfe2-dc58bc0d4678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4abb9d9-148f-4a85-bfe2-dc58bc0d4678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3c07e63-b324-43b4-9793-c75a2c2cb7a2', 'volume_name': 'volume-f3c07e63-b324-43b4-9793-c75a2c2cb7a2', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77cfb0c5-57fc-4adb-ab38-86311bc6d1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77cfb0c5-57fc-4adb-ab38-86311bc6d1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed6b9993-a19c-4f9b-96fa-12dc6d4b3986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:19 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Volume f3c07e63-b324-43b4-9793-c75a2c2cb7a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3c07e63-b324-43b4-9793-c75a2c2cb7a2', 'volume_size': 1} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f932bf4a-d1dc-46d5-87b0-dc57e5fd4518 tempest-SnapshotDependencyTests-30070103 None] Acquiring lock "cinder-633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f932bf4a-d1dc-46d5-87b0-dc57e5fd4518 tempest-SnapshotDependencyTests-30070103 None] Lock "cinder-633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f932bf4a-d1dc-46d5-87b0-dc57e5fd4518 tempest-SnapshotDependencyTests-30070103 None] Acquiring lock "cinder-quobyte-633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f932bf4a-d1dc-46d5-87b0-dc57e5fd4518 tempest-SnapshotDependencyTests-30070103 None] Lock "cinder-quobyte-633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae" acquired by "delete_volume" :: waited 0.019s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[16112bde-cf65-4782-93dd-bc221fa8c80c]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:01:19 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f932bf4a-d1dc-46d5-87b0-dc57e5fd4518 tempest-SnapshotDependencyTests-30070103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:20 devstack sudo[91401]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-28d80662-8825-4a28-8eea-3905cfe06edb 1073741824" returned: 0 in 0.895s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-28d80662-8825-4a28-8eea-3905cfe06edb {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:20 devstack sudo[91404]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:20 devstack sudo[91411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-28d80662-8825-4a28-8eea-3905cfe06edb Apr 25 16:01:20 devstack sudo[91411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-2c037f76-5c41-487c-84c8-6dc1796d8959 tempest-CinderUnicodeTest-593846682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890.2a546641-469e-4afe-a4b3-6d36de310aff" returned: 0 in 0.640s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:20 devstack sudo[91410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae Apr 25 16:01:20 devstack sudo[91410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Flow 'volume_create_manager' (84605d19-0650-453d-b544-a22a54ebba1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff58e627-5b51-4d10-a381-aa9cc54aaac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff58e627-5b51-4d10-a381-aa9cc54aaac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-798665895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=390cdd30-20d1-41ef-aa95-5e11db28090f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cef904e045a4b159f702e188e188d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:01:20Z,use_quota=True,user_id='c5f1873eb1ee467fb827c8712a23cde7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4daca877-5ad5-4fb7-b57b-8d70ded8a4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4daca877-5ad5-4fb7-b57b-8d70ded8a4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (452b0d7c-1fd4-483d-8fe4-8002f8c1e01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (452b0d7c-1fd4-483d-8fe4-8002f8c1e01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '390cdd30-20d1-41ef-aa95-5e11db28090f', 'volume_name': 'volume-390cdd30-20d1-41ef-aa95-5e11db28090f', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35dc7f43-e4fa-4fc4-9a53-30db29cdb98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35dc7f43-e4fa-4fc4-9a53-30db29cdb98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c10448-7d93-48a7-84fd-3d22db7e804e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:20 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Volume 390cdd30-20d1-41ef-aa95-5e11db28090f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-390cdd30-20d1-41ef-aa95-5e11db28090f', 'volume_size': 1} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-2c037f76-5c41-487c-84c8-6dc1796d8959 tempest-CinderUnicodeTest-593846682 None] Lock "cinder-quobyte-2a546641-469e-4afe-a4b3-6d36de310aff" released by "_delete_snapshot" :: held 2.786s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-2c037f76-5c41-487c-84c8-6dc1796d8959 tempest-CinderUnicodeTest-593846682 None] Lock "cinder-quobyte-b7736c4f-4b5d-4747-a3d6-2406c584d890" released by "delete_snapshot" :: held 2.811s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-2c037f76-5c41-487c-84c8-6dc1796d8959 tempest-CinderUnicodeTest-593846682 None] Created reservations ['59f856d2-e39f-4d88-9f2c-e4c81a28b5c0', '417362ba-c616-432c-8aed-e13ef562dcea', 'e922dc01-fdcc-4855-94f4-8fb233947d53', '8b11ae73-768e-44f1-b972-da8e0740dbde'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 16:01:20 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-2c037f76-5c41-487c-84c8-6dc1796d8959 tempest-CinderUnicodeTest-593846682 None] Delete snapshot completed successfully. Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-2c037f76-5c41-487c-84c8-6dc1796d8959 tempest-CinderUnicodeTest-593846682 None] Lock "cinder-2a546641-469e-4afe-a4b3-6d36de310aff-delete_snapshot" released by "delete_snapshot" :: held 2.981s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.volume.flows.manager.create_volume [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=81828) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Flow 'volume_create_manager' (302c8d14-6369-4be7-aab9-20d11e352c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e36c7a5c-aa8f-48ba-a663-3594f5287481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e36c7a5c-aa8f-48ba-a663-3594f5287481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-184514839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b59eebf-92cd-4770-aa4a-00e3a55760b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cef904e045a4b159f702e188e188d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:01:20Z,use_quota=True,user_id='c5f1873eb1ee467fb827c8712a23cde7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45b79a0a-d3fd-4a12-a0ff-79c2ccb896a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45b79a0a-d3fd-4a12-a0ff-79c2ccb896a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3cca9c6-ccff-46c1-a029-e8901fb60304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3cca9c6-ccff-46c1-a029-e8901fb60304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b59eebf-92cd-4770-aa4a-00e3a55760b1', 'volume_name': 'volume-8b59eebf-92cd-4770-aa4a-00e3a55760b1', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72ee41b7-b989-4ed5-b526-01f30b980a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72ee41b7-b989-4ed5-b526-01f30b980a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ae0bf9e-3e3e-4603-b189-2f1784160311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:20 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Volume 8b59eebf-92cd-4770-aa4a-00e3a55760b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b59eebf-92cd-4770-aa4a-00e3a55760b1', 'volume_size': 1} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-4b5d4bb6-158d-4469-a4bc-6060b10e8d32 tempest-CinderUnicodeTest-593846682 None] Acquiring lock "cinder-b7736c4f-4b5d-4747-a3d6-2406c584d890-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-4b5d4bb6-158d-4469-a4bc-6060b10e8d32 tempest-CinderUnicodeTest-593846682 None] Lock "cinder-b7736c4f-4b5d-4747-a3d6-2406c584d890-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-4b5d4bb6-158d-4469-a4bc-6060b10e8d32 tempest-CinderUnicodeTest-593846682 None] Acquiring lock "cinder-quobyte-b7736c4f-4b5d-4747-a3d6-2406c584d890" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-4b5d4bb6-158d-4469-a4bc-6060b10e8d32 tempest-CinderUnicodeTest-593846682 None] Lock "cinder-quobyte-b7736c4f-4b5d-4747-a3d6-2406c584d890" acquired by "delete_volume" :: waited 0.022s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:20 devstack sudo[91411]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-28d80662-8825-4a28-8eea-3905cfe06edb" returned: 0 in 0.629s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[df925ab8-fb88-498b-85d7-a5eaa9e4dd6f]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.247s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-876867972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b445f5e0-ca7c-4ee3-852d-0022d6213dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cef904e045a4b159f702e188e188d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:01:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:01:19Z,use_quota=True,user_id='c5f1873eb1ee467fb827c8712a23cde7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Creating volume b445f5e0-ca7c-4ee3-852d-0022d6213dae {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:01:20 devstack sudo[91410]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 16:01:20 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b445f5e0-ca7c-4ee3-852d-0022d6213dae 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4b5d4bb6-158d-4469-a4bc-6060b10e8d32 tempest-CinderUnicodeTest-593846682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:20 devstack sudo[91418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b445f5e0-ca7c-4ee3-852d-0022d6213dae 1073741824 Apr 25 16:01:20 devstack sudo[91418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af22e62-9473-414c-88bc-377b172b6d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28d80662-8825-4a28-8eea-3905cfe06edb', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1128036b-a900-461b-8f28-4f80785e7a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f932bf4a-d1dc-46d5-87b0-dc57e5fd4518 tempest-SnapshotDependencyTests-30070103 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae" returned: 0 in 0.769s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:20 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Volume volume-28d80662-8825-4a28-8eea-3905cfe06edb (28d80662-8825-4a28-8eea-3905cfe06edb): created successfully Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1128036b-a900-461b-8f28-4f80785e7a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Flow 'volume_create_manager' (6f456e02-1a4c-4e55-b1ef-07ad508cb8db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:01:20 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f932bf4a-d1dc-46d5-87b0-dc57e5fd4518 tempest-SnapshotDependencyTests-30070103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:20 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-aba2db36-5075-4457-ad35-10d88aa7c3f9 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Created volume successfully. Apr 25 16:01:20 devstack sudo[91421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae Apr 25 16:01:20 devstack sudo[91421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:20 devstack sudo[91419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890 Apr 25 16:01:20 devstack sudo[91419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:21 devstack sudo[91421]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f932bf4a-d1dc-46d5-87b0-dc57e5fd4518 tempest-SnapshotDependencyTests-30070103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae" returned: 0 in 0.498s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f932bf4a-d1dc-46d5-87b0-dc57e5fd4518 tempest-SnapshotDependencyTests-30070103 None] Lock "cinder-quobyte-633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae" released by "delete_volume" :: held 1.315s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:21 devstack sudo[91418]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:21 devstack sudo[91419]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b445f5e0-ca7c-4ee3-852d-0022d6213dae 1073741824" returned: 0 in 0.592s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4b5d4bb6-158d-4469-a4bc-6060b10e8d32 tempest-CinderUnicodeTest-593846682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890" returned: 0 in 0.593s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4b5d4bb6-158d-4469-a4bc-6060b10e8d32 tempest-CinderUnicodeTest-593846682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:21 devstack sudo[91431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890 Apr 25 16:01:21 devstack sudo[91431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b445f5e0-ca7c-4ee3-852d-0022d6213dae {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-f932bf4a-d1dc-46d5-87b0-dc57e5fd4518 tempest-SnapshotDependencyTests-30070103 None] Created reservations ['e006eb61-204f-4f38-b45b-69c9d5b081eb', '1a805716-a24e-4bdc-afee-8af124c89739', 'b6e54a42-8f60-4bae-9ceb-f7b7eeea216d', 'd6e8d0c8-d700-475f-8c6e-1e5b4f13dbe3'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 16:01:21 devstack sudo[91433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b445f5e0-ca7c-4ee3-852d-0022d6213dae Apr 25 16:01:21 devstack sudo[91433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f932bf4a-d1dc-46d5-87b0-dc57e5fd4518 tempest-SnapshotDependencyTests-30070103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f932bf4a-d1dc-46d5-87b0-dc57e5fd4518 tempest-SnapshotDependencyTests-30070103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f932bf4a-d1dc-46d5-87b0-dc57e5fd4518 tempest-SnapshotDependencyTests-30070103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-f932bf4a-d1dc-46d5-87b0-dc57e5fd4518 tempest-SnapshotDependencyTests-30070103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-f932bf4a-d1dc-46d5-87b0-dc57e5fd4518 tempest-SnapshotDependencyTests-30070103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f932bf4a-d1dc-46d5-87b0-dc57e5fd4518 tempest-SnapshotDependencyTests-30070103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:21 devstack sudo[91436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 16:01:21 devstack sudo[91436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:21 devstack sudo[91431]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4b5d4bb6-158d-4469-a4bc-6060b10e8d32 tempest-CinderUnicodeTest-593846682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b7736c4f-4b5d-4747-a3d6-2406c584d890" returned: 0 in 0.493s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-4b5d4bb6-158d-4469-a4bc-6060b10e8d32 tempest-CinderUnicodeTest-593846682 None] Lock "cinder-quobyte-b7736c4f-4b5d-4747-a3d6-2406c584d890" released by "delete_volume" :: held 1.170s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:21 devstack sudo[91433]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b445f5e0-ca7c-4ee3-852d-0022d6213dae" returned: 0 in 0.507s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.976s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:01:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-273763406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3c07e63-b324-43b4-9793-c75a2c2cb7a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cef904e045a4b159f702e188e188d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:01:20Z,use_quota=True,user_id='c5f1873eb1ee467fb827c8712a23cde7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Creating volume f3c07e63-b324-43b4-9793-c75a2c2cb7a2 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 16:01:21 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f3c07e63-b324-43b4-9793-c75a2c2cb7a2 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:21 devstack sudo[91441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f3c07e63-b324-43b4-9793-c75a2c2cb7a2 1073741824 Apr 25 16:01:21 devstack sudo[91441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a07adcf8-a8d3-4e4d-9825-af24c599f041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b445f5e0-ca7c-4ee3-852d-0022d6213dae', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a67d4d4-a3f6-44db-8833-59d7fc961c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:21 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Volume volume-b445f5e0-ca7c-4ee3-852d-0022d6213dae (b445f5e0-ca7c-4ee3-852d-0022d6213dae): created successfully Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a67d4d4-a3f6-44db-8833-59d7fc961c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Flow 'volume_create_manager' (8e2b9424-a60c-421d-abaf-ce696b78b798) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-4b5d4bb6-158d-4469-a4bc-6060b10e8d32 tempest-CinderUnicodeTest-593846682 None] Created reservations ['004cd174-dbf5-471f-986b-f70f309767c9', 'f3f9cf4e-530d-4b60-afe8-8a90eea585a2', 'f0e9d589-a13b-40f4-842d-5cabe2dc06af', 'df165861-935d-4665-8235-c3e19a57a2d2'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 16:01:21 devstack sudo[91436]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-f932bf4a-d1dc-46d5-87b0-dc57e5fd4518 tempest-SnapshotDependencyTests-30070103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.493s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:21 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-f932bf4a-d1dc-46d5-87b0-dc57e5fd4518 tempest-SnapshotDependencyTests-30070103 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 16:01:21 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-f932bf4a-d1dc-46d5-87b0-dc57e5fd4518 tempest-SnapshotDependencyTests-30070103 None] Deleted volume successfully. Apr 25 16:01:21 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-c5df40b3-2211-43b5-80bb-8d1ef17797ee tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Created volume successfully. Apr 25 16:01:22 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-f932bf4a-d1dc-46d5-87b0-dc57e5fd4518 tempest-SnapshotDependencyTests-30070103 None] Lock "cinder-633e3119-042d-4aa0-a8a0-b2a6ffb1f4ae-delete_volume" released by "delete_volume" :: held 2.093s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4b5d4bb6-158d-4469-a4bc-6060b10e8d32 tempest-CinderUnicodeTest-593846682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:01:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4b5d4bb6-158d-4469-a4bc-6060b10e8d32 tempest-CinderUnicodeTest-593846682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:01:22 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d4bb6-158d-4469-a4bc-6060b10e8d32 tempest-CinderUnicodeTest-593846682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:01:22 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4b5d4bb6-158d-4469-a4bc-6060b10e8d32 tempest-CinderUnicodeTest-593846682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:01:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4b5d4bb6-158d-4469-a4bc-6060b10e8d32 tempest-CinderUnicodeTest-593846682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:01:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4b5d4bb6-158d-4469-a4bc-6060b10e8d32 tempest-CinderUnicodeTest-593846682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:22 devstack sudo[91443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 16:01:22 devstack sudo[91443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:22 devstack sudo[91441]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f3c07e63-b324-43b4-9793-c75a2c2cb7a2 1073741824" returned: 0 in 0.626s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f3c07e63-b324-43b4-9793-c75a2c2cb7a2 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:22 devstack sudo[91449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f3c07e63-b324-43b4-9793-c75a2c2cb7a2 Apr 25 16:01:22 devstack sudo[91449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:22 devstack sudo[91443]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4b5d4bb6-158d-4469-a4bc-6060b10e8d32 tempest-CinderUnicodeTest-593846682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.548s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:22 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-4b5d4bb6-158d-4469-a4bc-6060b10e8d32 tempest-CinderUnicodeTest-593846682 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 16:01:22 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-4b5d4bb6-158d-4469-a4bc-6060b10e8d32 tempest-CinderUnicodeTest-593846682 None] Deleted volume successfully. Apr 25 16:01:22 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-4b5d4bb6-158d-4469-a4bc-6060b10e8d32 tempest-CinderUnicodeTest-593846682 None] Lock "cinder-b7736c4f-4b5d-4747-a3d6-2406c584d890-delete_volume" released by "delete_volume" :: held 2.036s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:22 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-4571d5c9-b773-4325-96d3-607a99d6422e tempest-CinderUnicodeTest-593846682 None] Acquiring lock "cinder-e576b9c6-6793-4870-a7d3-9f73a5f6d989-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:22 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-4571d5c9-b773-4325-96d3-607a99d6422e tempest-CinderUnicodeTest-593846682 None] Lock "cinder-e576b9c6-6793-4870-a7d3-9f73a5f6d989-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:22 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-4571d5c9-b773-4325-96d3-607a99d6422e tempest-CinderUnicodeTest-593846682 None] Acquiring lock "cinder-quobyte-e576b9c6-6793-4870-a7d3-9f73a5f6d989" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:22 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-4571d5c9-b773-4325-96d3-607a99d6422e tempest-CinderUnicodeTest-593846682 None] Lock "cinder-quobyte-e576b9c6-6793-4870-a7d3-9f73a5f6d989" acquired by "delete_volume" :: waited 0.019s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:22 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[821433ab-0c0d-498c-a1c6-bea3a5946bce]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:01:22 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4571d5c9-b773-4325-96d3-607a99d6422e tempest-CinderUnicodeTest-593846682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e576b9c6-6793-4870-a7d3-9f73a5f6d989 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:23 devstack sudo[91451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e576b9c6-6793-4870-a7d3-9f73a5f6d989 Apr 25 16:01:23 devstack sudo[91451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:23 devstack sudo[91449]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f3c07e63-b324-43b4-9793-c75a2c2cb7a2" returned: 0 in 0.511s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:23 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 16:01:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:01:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.832s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:01:23 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-798665895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=390cdd30-20d1-41ef-aa95-5e11db28090f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cef904e045a4b159f702e188e188d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:01:20Z,use_quota=True,user_id='c5f1873eb1ee467fb827c8712a23cde7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 16:01:23 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Creating volume 390cdd30-20d1-41ef-aa95-5e11db28090f {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 16:01:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:01:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:01:23 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:01:23 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:01:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:01:23 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 16:01:23 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 16:01:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-390cdd30-20d1-41ef-aa95-5e11db28090f 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:23 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed6b9993-a19c-4f9b-96fa-12dc6d4b3986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3c07e63-b324-43b4-9793-c75a2c2cb7a2', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:23 devstack sudo[91454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-390cdd30-20d1-41ef-aa95-5e11db28090f 1073741824 Apr 25 16:01:23 devstack sudo[91454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:23 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6d4e72d-22b5-44b5-9636-c368ca973e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:23 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Volume volume-f3c07e63-b324-43b4-9793-c75a2c2cb7a2 (f3c07e63-b324-43b4-9793-c75a2c2cb7a2): created successfully Apr 25 16:01:23 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6d4e72d-22b5-44b5-9636-c368ca973e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:23 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Flow 'volume_create_manager' (9046383f-e968-4904-9f69-e85250fe2a54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:01:23 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-bcbdcdc7-71e2-4627-9a1d-50388289dc0f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Created volume successfully. Apr 25 16:01:23 devstack sudo[91451]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4571d5c9-b773-4325-96d3-607a99d6422e tempest-CinderUnicodeTest-593846682 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e576b9c6-6793-4870-a7d3-9f73a5f6d989" returned: 0 in 0.552s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4571d5c9-b773-4325-96d3-607a99d6422e tempest-CinderUnicodeTest-593846682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e576b9c6-6793-4870-a7d3-9f73a5f6d989 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:23 devstack sudo[91463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e576b9c6-6793-4870-a7d3-9f73a5f6d989 Apr 25 16:01:23 devstack sudo[91463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:23 devstack sudo[91454]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-390cdd30-20d1-41ef-aa95-5e11db28090f 1073741824" returned: 0 in 0.654s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:23 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-390cdd30-20d1-41ef-aa95-5e11db28090f {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:23 devstack sudo[91465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-390cdd30-20d1-41ef-aa95-5e11db28090f Apr 25 16:01:23 devstack sudo[91465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:24 devstack sudo[91463]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4571d5c9-b773-4325-96d3-607a99d6422e tempest-CinderUnicodeTest-593846682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-e576b9c6-6793-4870-a7d3-9f73a5f6d989" returned: 0 in 0.529s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:24 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-4571d5c9-b773-4325-96d3-607a99d6422e tempest-CinderUnicodeTest-593846682 None] Lock "cinder-quobyte-e576b9c6-6793-4870-a7d3-9f73a5f6d989" released by "delete_volume" :: held 1.124s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:24 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-4571d5c9-b773-4325-96d3-607a99d6422e tempest-CinderUnicodeTest-593846682 None] Created reservations ['3bb10f55-350d-4641-94e1-6f165cc0ea71', '77f530a4-dcf1-47a1-b820-cbaf43843792', '97be3596-0b4c-43e4-90d7-77f14d21be22', '67a878a2-cb7a-49f0-b310-6a820074aeab'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 16:01:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4571d5c9-b773-4325-96d3-607a99d6422e tempest-CinderUnicodeTest-593846682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:01:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4571d5c9-b773-4325-96d3-607a99d6422e tempest-CinderUnicodeTest-593846682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:01:24 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4571d5c9-b773-4325-96d3-607a99d6422e tempest-CinderUnicodeTest-593846682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:01:24 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-4571d5c9-b773-4325-96d3-607a99d6422e tempest-CinderUnicodeTest-593846682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:01:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-4571d5c9-b773-4325-96d3-607a99d6422e tempest-CinderUnicodeTest-593846682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:01:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4571d5c9-b773-4325-96d3-607a99d6422e tempest-CinderUnicodeTest-593846682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:24 devstack sudo[91469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 16:01:24 devstack sudo[91469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:24 devstack sudo[91465]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-390cdd30-20d1-41ef-aa95-5e11db28090f" returned: 0 in 0.480s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:24 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 16:01:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:01:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.714s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:01:24 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-25T14:01:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-184514839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b59eebf-92cd-4770-aa4a-00e3a55760b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cef904e045a4b159f702e188e188d7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-25T14:01:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-25T14:01:20Z,use_quota=True,user_id='c5f1873eb1ee467fb827c8712a23cde7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cae102b9-63ca-42d0-bf0a-fbdd3cac6e73),volume_type_id=cae102b9-63ca-42d0-bf0a-fbdd3cac6e73)}" {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 25 16:01:24 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.remotefs [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Creating volume 8b59eebf-92cd-4770-aa4a-00e3a55760b1 {{(pid=81828) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 25 16:01:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:01:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:01:24 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:01:24 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:01:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:01:24 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Selected osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf as target Quobyte volume. {{(pid=81828) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 25 16:01:24 devstack cinder-volume[81828]: INFO cinder.volume.drivers.remotefs [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] casted to osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf Apr 25 16:01:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8b59eebf-92cd-4770-aa4a-00e3a55760b1 1073741824 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4c10448-7d93-48a7-84fd-3d22db7e804e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-390cdd30-20d1-41ef-aa95-5e11db28090f', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d9979cb-0865-4a4a-a284-131fd4c99400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:24 devstack sudo[91471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8b59eebf-92cd-4770-aa4a-00e3a55760b1 1073741824 Apr 25 16:01:24 devstack sudo[91471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:24 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Volume volume-390cdd30-20d1-41ef-aa95-5e11db28090f (390cdd30-20d1-41ef-aa95-5e11db28090f): created successfully Apr 25 16:01:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d9979cb-0865-4a4a-a284-131fd4c99400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:24 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Flow 'volume_create_manager' (84605d19-0650-453d-b544-a22a54ebba1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:01:24 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-ec0f8930-c63d-4aad-9172-898d2b209e9c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Created volume successfully. Apr 25 16:01:24 devstack sudo[91469]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:24 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-4571d5c9-b773-4325-96d3-607a99d6422e tempest-CinderUnicodeTest-593846682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.570s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:24 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-4571d5c9-b773-4325-96d3-607a99d6422e tempest-CinderUnicodeTest-593846682 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 16:01:24 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-4571d5c9-b773-4325-96d3-607a99d6422e tempest-CinderUnicodeTest-593846682 None] Deleted volume successfully. Apr 25 16:01:24 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-4571d5c9-b773-4325-96d3-607a99d6422e tempest-CinderUnicodeTest-593846682 None] Lock "cinder-e576b9c6-6793-4870-a7d3-9f73a5f6d989-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:25 devstack sudo[91471]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8b59eebf-92cd-4770-aa4a-00e3a55760b1 1073741824" returned: 0 in 0.788s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8b59eebf-92cd-4770-aa4a-00e3a55760b1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:25 devstack sudo[91477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8b59eebf-92cd-4770-aa4a-00e3a55760b1 Apr 25 16:01:25 devstack sudo[91477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:25 devstack sudo[91477]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8b59eebf-92cd-4770-aa4a-00e3a55760b1" returned: 0 in 0.572s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:25 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'} {{(pid=81828) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 25 16:01:25 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:01:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ae0bf9e-3e3e-4603-b189-2f1784160311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b59eebf-92cd-4770-aa4a-00e3a55760b1', 'volume_size': 1}' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4370077-4b30-4654-90d3-531010591ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 25 16:01:25 devstack cinder-volume[81828]: INFO cinder.volume.flows.manager.create_volume [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Volume volume-8b59eebf-92cd-4770-aa4a-00e3a55760b1 (8b59eebf-92cd-4770-aa4a-00e3a55760b1): created successfully Apr 25 16:01:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4370077-4b30-4654-90d3-531010591ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=81828) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 25 16:01:25 devstack cinder-volume[81828]: DEBUG cinder.volume.manager [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Flow 'volume_create_manager' (302c8d14-6369-4be7-aab9-20d11e352c22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=81828) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 25 16:01:25 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-22ee6b00-40dc-4500-8f04-23b8829a21d3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Created volume successfully. Apr 25 16:01:26 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a3f09285-521b-4dff-adfc-e87ec1baec3f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Acquiring lock "cinder-8b59eebf-92cd-4770-aa4a-00e3a55760b1-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:26 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a3f09285-521b-4dff-adfc-e87ec1baec3f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "cinder-8b59eebf-92cd-4770-aa4a-00e3a55760b1-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:26 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a3f09285-521b-4dff-adfc-e87ec1baec3f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Acquiring lock "cinder-quobyte-8b59eebf-92cd-4770-aa4a-00e3a55760b1" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:26 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a3f09285-521b-4dff-adfc-e87ec1baec3f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "cinder-quobyte-8b59eebf-92cd-4770-aa4a-00e3a55760b1" acquired by "delete_volume" :: waited 0.021s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:26 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cfb6b6-3752-4c41-ad98-1d9de78bb81a]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:01:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a3f09285-521b-4dff-adfc-e87ec1baec3f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8b59eebf-92cd-4770-aa4a-00e3a55760b1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:26 devstack sudo[91481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8b59eebf-92cd-4770-aa4a-00e3a55760b1 Apr 25 16:01:26 devstack sudo[91481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:26 devstack sudo[91481]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a3f09285-521b-4dff-adfc-e87ec1baec3f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8b59eebf-92cd-4770-aa4a-00e3a55760b1" returned: 0 in 0.611s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:26 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a3f09285-521b-4dff-adfc-e87ec1baec3f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8b59eebf-92cd-4770-aa4a-00e3a55760b1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:26 devstack sudo[91486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8b59eebf-92cd-4770-aa4a-00e3a55760b1 Apr 25 16:01:26 devstack sudo[91486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:27 devstack sudo[91486]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a3f09285-521b-4dff-adfc-e87ec1baec3f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-8b59eebf-92cd-4770-aa4a-00e3a55760b1" returned: 0 in 0.474s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:27 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a3f09285-521b-4dff-adfc-e87ec1baec3f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "cinder-quobyte-8b59eebf-92cd-4770-aa4a-00e3a55760b1" released by "delete_volume" :: held 1.127s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:27 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-a3f09285-521b-4dff-adfc-e87ec1baec3f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Created reservations ['7c8c01f0-0c6e-43e3-9fdf-b55d107071d1', '8d77c513-3b72-47d2-9832-4d96959f6e47', '3780aa8a-9bd6-419f-9336-c0b889a7e4da', 'cbeab3c0-a67e-46ca-abcf-4db32a4f6272'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 16:01:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-a3f09285-521b-4dff-adfc-e87ec1baec3f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:01:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-a3f09285-521b-4dff-adfc-e87ec1baec3f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:01:27 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-a3f09285-521b-4dff-adfc-e87ec1baec3f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:01:27 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-a3f09285-521b-4dff-adfc-e87ec1baec3f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:01:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-a3f09285-521b-4dff-adfc-e87ec1baec3f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:01:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a3f09285-521b-4dff-adfc-e87ec1baec3f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:27 devstack sudo[91490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 16:01:27 devstack sudo[91490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:27 devstack sudo[91490]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:27 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-a3f09285-521b-4dff-adfc-e87ec1baec3f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.510s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:27 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-a3f09285-521b-4dff-adfc-e87ec1baec3f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 16:01:27 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-a3f09285-521b-4dff-adfc-e87ec1baec3f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Deleted volume successfully. Apr 25 16:01:27 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-a3f09285-521b-4dff-adfc-e87ec1baec3f tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "cinder-8b59eebf-92cd-4770-aa4a-00e3a55760b1-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:28 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-518adb68-6ba3-4071-af9f-7230c9c46625 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Acquiring lock "cinder-390cdd30-20d1-41ef-aa95-5e11db28090f-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:28 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-518adb68-6ba3-4071-af9f-7230c9c46625 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "cinder-390cdd30-20d1-41ef-aa95-5e11db28090f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:28 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-518adb68-6ba3-4071-af9f-7230c9c46625 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Acquiring lock "cinder-quobyte-390cdd30-20d1-41ef-aa95-5e11db28090f" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:28 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-518adb68-6ba3-4071-af9f-7230c9c46625 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "cinder-quobyte-390cdd30-20d1-41ef-aa95-5e11db28090f" acquired by "delete_volume" :: waited 0.024s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:28 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b5d150-a176-4aa1-9c5c-50d00844024d]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:01:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-518adb68-6ba3-4071-af9f-7230c9c46625 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-390cdd30-20d1-41ef-aa95-5e11db28090f {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:28 devstack sudo[91493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-390cdd30-20d1-41ef-aa95-5e11db28090f Apr 25 16:01:28 devstack sudo[91493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:28 devstack sudo[91493]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-518adb68-6ba3-4071-af9f-7230c9c46625 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-390cdd30-20d1-41ef-aa95-5e11db28090f" returned: 0 in 0.561s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:28 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-518adb68-6ba3-4071-af9f-7230c9c46625 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-390cdd30-20d1-41ef-aa95-5e11db28090f {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:29 devstack sudo[91499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-390cdd30-20d1-41ef-aa95-5e11db28090f Apr 25 16:01:29 devstack sudo[91499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:29 devstack sudo[91499]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-518adb68-6ba3-4071-af9f-7230c9c46625 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-390cdd30-20d1-41ef-aa95-5e11db28090f" returned: 0 in 0.529s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:29 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-518adb68-6ba3-4071-af9f-7230c9c46625 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "cinder-quobyte-390cdd30-20d1-41ef-aa95-5e11db28090f" released by "delete_volume" :: held 1.135s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:29 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-518adb68-6ba3-4071-af9f-7230c9c46625 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Created reservations ['82d2686a-0289-4ce4-8ddc-2af915a49fa4', '19b56a67-3bf3-410f-99a5-023912335b90', '720dff96-21c4-4f97-8b25-22d84600e3ef', '73a56f10-4e69-4e8e-bece-3debf24859da'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 16:01:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-518adb68-6ba3-4071-af9f-7230c9c46625 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:01:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-518adb68-6ba3-4071-af9f-7230c9c46625 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:01:29 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-518adb68-6ba3-4071-af9f-7230c9c46625 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:01:29 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-518adb68-6ba3-4071-af9f-7230c9c46625 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:01:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-518adb68-6ba3-4071-af9f-7230c9c46625 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:01:29 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-518adb68-6ba3-4071-af9f-7230c9c46625 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:29 devstack sudo[91502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 16:01:29 devstack sudo[91502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:30 devstack sudo[91502]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-518adb68-6ba3-4071-af9f-7230c9c46625 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.474s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:30 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-518adb68-6ba3-4071-af9f-7230c9c46625 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 16:01:30 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-518adb68-6ba3-4071-af9f-7230c9c46625 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Deleted volume successfully. Apr 25 16:01:30 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-518adb68-6ba3-4071-af9f-7230c9c46625 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "cinder-390cdd30-20d1-41ef-aa95-5e11db28090f-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:30 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ee0a34dc-4d3b-4ad1-a6a2-0a5c940b856c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Acquiring lock "cinder-f3c07e63-b324-43b4-9793-c75a2c2cb7a2-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:30 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ee0a34dc-4d3b-4ad1-a6a2-0a5c940b856c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "cinder-f3c07e63-b324-43b4-9793-c75a2c2cb7a2-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:30 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ee0a34dc-4d3b-4ad1-a6a2-0a5c940b856c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Acquiring lock "cinder-quobyte-f3c07e63-b324-43b4-9793-c75a2c2cb7a2" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:30 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ee0a34dc-4d3b-4ad1-a6a2-0a5c940b856c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "cinder-quobyte-f3c07e63-b324-43b4-9793-c75a2c2cb7a2" acquired by "delete_volume" :: waited 0.018s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:30 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[5035fed2-07cb-4f59-897c-3f35161b2651]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:01:30 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ee0a34dc-4d3b-4ad1-a6a2-0a5c940b856c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f3c07e63-b324-43b4-9793-c75a2c2cb7a2 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:30 devstack sudo[91505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f3c07e63-b324-43b4-9793-c75a2c2cb7a2 Apr 25 16:01:30 devstack sudo[91505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:31 devstack sudo[91505]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ee0a34dc-4d3b-4ad1-a6a2-0a5c940b856c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f3c07e63-b324-43b4-9793-c75a2c2cb7a2" returned: 0 in 0.525s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ee0a34dc-4d3b-4ad1-a6a2-0a5c940b856c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f3c07e63-b324-43b4-9793-c75a2c2cb7a2 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:31 devstack sudo[91510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f3c07e63-b324-43b4-9793-c75a2c2cb7a2 Apr 25 16:01:31 devstack sudo[91510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:31 devstack sudo[91510]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ee0a34dc-4d3b-4ad1-a6a2-0a5c940b856c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-f3c07e63-b324-43b4-9793-c75a2c2cb7a2" returned: 0 in 0.430s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:31 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ee0a34dc-4d3b-4ad1-a6a2-0a5c940b856c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "cinder-quobyte-f3c07e63-b324-43b4-9793-c75a2c2cb7a2" released by "delete_volume" :: held 0.996s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:31 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-ee0a34dc-4d3b-4ad1-a6a2-0a5c940b856c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Created reservations ['9d14a10d-063b-4361-af02-852d18c10adc', 'fcf10d9d-a52f-4751-b928-2b76d8cdb1c5', '1d30474f-c87e-40b0-ab6c-816f6b4bc349', '5637d703-1f47-467b-961b-0cf34e615824'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 16:01:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ee0a34dc-4d3b-4ad1-a6a2-0a5c940b856c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:01:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ee0a34dc-4d3b-4ad1-a6a2-0a5c940b856c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:01:31 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-ee0a34dc-4d3b-4ad1-a6a2-0a5c940b856c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:01:31 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-ee0a34dc-4d3b-4ad1-a6a2-0a5c940b856c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:01:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-ee0a34dc-4d3b-4ad1-a6a2-0a5c940b856c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:01:31 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ee0a34dc-4d3b-4ad1-a6a2-0a5c940b856c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:31 devstack sudo[91514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 16:01:31 devstack sudo[91514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:32 devstack sudo[91514]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-ee0a34dc-4d3b-4ad1-a6a2-0a5c940b856c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.414s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:32 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-ee0a34dc-4d3b-4ad1-a6a2-0a5c940b856c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 16:01:32 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-ee0a34dc-4d3b-4ad1-a6a2-0a5c940b856c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Deleted volume successfully. Apr 25 16:01:32 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-ee0a34dc-4d3b-4ad1-a6a2-0a5c940b856c tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "cinder-f3c07e63-b324-43b4-9793-c75a2c2cb7a2-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:32 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5ebac758-152d-46dd-987e-7468c9eb3f2b tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Acquiring lock "cinder-b445f5e0-ca7c-4ee3-852d-0022d6213dae-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:32 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5ebac758-152d-46dd-987e-7468c9eb3f2b tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "cinder-b445f5e0-ca7c-4ee3-852d-0022d6213dae-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:32 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5ebac758-152d-46dd-987e-7468c9eb3f2b tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Acquiring lock "cinder-quobyte-b445f5e0-ca7c-4ee3-852d-0022d6213dae" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:32 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5ebac758-152d-46dd-987e-7468c9eb3f2b tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "cinder-quobyte-b445f5e0-ca7c-4ee3-852d-0022d6213dae" acquired by "delete_volume" :: waited 0.017s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:32 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a63ef7-d07f-4efc-933b-9a3831196d78]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:01:32 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5ebac758-152d-46dd-987e-7468c9eb3f2b tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b445f5e0-ca7c-4ee3-852d-0022d6213dae {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:32 devstack sudo[91517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b445f5e0-ca7c-4ee3-852d-0022d6213dae Apr 25 16:01:32 devstack sudo[91517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:33 devstack sudo[91517]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5ebac758-152d-46dd-987e-7468c9eb3f2b tempest-CreateVolumesFromSourceVolumeTest-215705290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b445f5e0-ca7c-4ee3-852d-0022d6213dae" returned: 0 in 0.518s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5ebac758-152d-46dd-987e-7468c9eb3f2b tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b445f5e0-ca7c-4ee3-852d-0022d6213dae {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:33 devstack sudo[91523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b445f5e0-ca7c-4ee3-852d-0022d6213dae Apr 25 16:01:33 devstack sudo[91523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:33 devstack sudo[91523]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5ebac758-152d-46dd-987e-7468c9eb3f2b tempest-CreateVolumesFromSourceVolumeTest-215705290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-b445f5e0-ca7c-4ee3-852d-0022d6213dae" returned: 0 in 0.423s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:33 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5ebac758-152d-46dd-987e-7468c9eb3f2b tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "cinder-quobyte-b445f5e0-ca7c-4ee3-852d-0022d6213dae" released by "delete_volume" :: held 0.979s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:33 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-5ebac758-152d-46dd-987e-7468c9eb3f2b tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Created reservations ['9a471297-e587-4a0b-a129-08a830afc20f', '9763303d-0edf-44fa-859c-d77b2f94faf7', '65d548de-4e2a-4771-853c-0eff542fd32f', '49750b12-3d2e-4dc7-93cd-b211e1a45f0e'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 16:01:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-5ebac758-152d-46dd-987e-7468c9eb3f2b tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:01:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-5ebac758-152d-46dd-987e-7468c9eb3f2b tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:01:33 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-5ebac758-152d-46dd-987e-7468c9eb3f2b tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:01:33 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-5ebac758-152d-46dd-987e-7468c9eb3f2b tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:01:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-5ebac758-152d-46dd-987e-7468c9eb3f2b tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:01:33 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5ebac758-152d-46dd-987e-7468c9eb3f2b tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:33 devstack sudo[91526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 16:01:33 devstack sudo[91526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:34 devstack sudo[91526]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:34 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-5ebac758-152d-46dd-987e-7468c9eb3f2b tempest-CreateVolumesFromSourceVolumeTest-215705290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.446s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:34 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-5ebac758-152d-46dd-987e-7468c9eb3f2b tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 16:01:34 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-5ebac758-152d-46dd-987e-7468c9eb3f2b tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Deleted volume successfully. Apr 25 16:01:34 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-5ebac758-152d-46dd-987e-7468c9eb3f2b tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "cinder-b445f5e0-ca7c-4ee3-852d-0022d6213dae-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:34 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d5ba40dd-45e1-4601-8392-53c047a62dd3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Acquiring lock "cinder-28d80662-8825-4a28-8eea-3905cfe06edb-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:34 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d5ba40dd-45e1-4601-8392-53c047a62dd3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "cinder-28d80662-8825-4a28-8eea-3905cfe06edb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:35 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d5ba40dd-45e1-4601-8392-53c047a62dd3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Acquiring lock "cinder-quobyte-28d80662-8825-4a28-8eea-3905cfe06edb" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:35 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d5ba40dd-45e1-4601-8392-53c047a62dd3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "cinder-quobyte-28d80662-8825-4a28-8eea-3905cfe06edb" acquired by "delete_volume" :: waited 0.013s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:35 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3550ab7-76e4-4ef2-9bf7-4d9aa8206ffd]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:01:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d5ba40dd-45e1-4601-8392-53c047a62dd3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-28d80662-8825-4a28-8eea-3905cfe06edb {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:35 devstack sudo[91529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-28d80662-8825-4a28-8eea-3905cfe06edb Apr 25 16:01:35 devstack sudo[91529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:35 devstack sudo[91529]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d5ba40dd-45e1-4601-8392-53c047a62dd3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-28d80662-8825-4a28-8eea-3905cfe06edb" returned: 0 in 0.514s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:35 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d5ba40dd-45e1-4601-8392-53c047a62dd3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-28d80662-8825-4a28-8eea-3905cfe06edb {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:35 devstack sudo[91534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-28d80662-8825-4a28-8eea-3905cfe06edb Apr 25 16:01:35 devstack sudo[91534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:36 devstack sudo[91534]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d5ba40dd-45e1-4601-8392-53c047a62dd3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-28d80662-8825-4a28-8eea-3905cfe06edb" returned: 0 in 0.424s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:36 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d5ba40dd-45e1-4601-8392-53c047a62dd3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "cinder-quobyte-28d80662-8825-4a28-8eea-3905cfe06edb" released by "delete_volume" :: held 0.980s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:36 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-d5ba40dd-45e1-4601-8392-53c047a62dd3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Created reservations ['c0b97737-7445-43c9-b294-a07a53e4ffb2', 'a9d23039-c793-49a0-aec7-51c0eae54ef8', '46cb9146-2158-40ab-90ad-080ee04f6a78', 'cacf181a-349a-4f8c-8440-6e41beb3f0f2'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 16:01:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d5ba40dd-45e1-4601-8392-53c047a62dd3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:01:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d5ba40dd-45e1-4601-8392-53c047a62dd3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:01:36 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d5ba40dd-45e1-4601-8392-53c047a62dd3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:01:36 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-d5ba40dd-45e1-4601-8392-53c047a62dd3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:01:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-d5ba40dd-45e1-4601-8392-53c047a62dd3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:01:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d5ba40dd-45e1-4601-8392-53c047a62dd3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:36 devstack sudo[91537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 16:01:36 devstack sudo[91537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:36 devstack sudo[91537]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:36 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-d5ba40dd-45e1-4601-8392-53c047a62dd3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.443s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:36 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-d5ba40dd-45e1-4601-8392-53c047a62dd3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 16:01:36 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-d5ba40dd-45e1-4601-8392-53c047a62dd3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Deleted volume successfully. Apr 25 16:01:36 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-d5ba40dd-45e1-4601-8392-53c047a62dd3 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "cinder-28d80662-8825-4a28-8eea-3905cfe06edb-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:37 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-528dfe83-aced-42a3-8c95-d971eaeb6d02 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Acquiring lock "cinder-0a120cde-7ff5-4a3c-9402-52586085bb9f-delete_volume" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:37 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-528dfe83-aced-42a3-8c95-d971eaeb6d02 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "cinder-0a120cde-7ff5-4a3c-9402-52586085bb9f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:37 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-528dfe83-aced-42a3-8c95-d971eaeb6d02 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Acquiring lock "cinder-quobyte-0a120cde-7ff5-4a3c-9402-52586085bb9f" by "delete_volume" {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 25 16:01:37 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-528dfe83-aced-42a3-8c95-d971eaeb6d02 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "cinder-quobyte-0a120cde-7ff5-4a3c-9402-52586085bb9f" acquired by "delete_volume" :: waited 0.015s {{(pid=81828) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 25 16:01:37 devstack cinder-volume[81828]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf5e724-ec2e-4de0-818a-fc2d804cb0e1]: (4, 'qcow2') {{(pid=82776) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 25 16:01:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-528dfe83-aced-42a3-8c95-d971eaeb6d02 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0a120cde-7ff5-4a3c-9402-52586085bb9f {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:37 devstack sudo[91540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0a120cde-7ff5-4a3c-9402-52586085bb9f Apr 25 16:01:37 devstack sudo[91540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:37 devstack sudo[91540]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-528dfe83-aced-42a3-8c95-d971eaeb6d02 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0a120cde-7ff5-4a3c-9402-52586085bb9f" returned: 0 in 0.483s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:37 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-528dfe83-aced-42a3-8c95-d971eaeb6d02 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0a120cde-7ff5-4a3c-9402-52586085bb9f {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:37 devstack sudo[91545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0a120cde-7ff5-4a3c-9402-52586085bb9f Apr 25 16:01:37 devstack sudo[91545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:38 devstack sudo[91545]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-528dfe83-aced-42a3-8c95-d971eaeb6d02 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1/volume-0a120cde-7ff5-4a3c-9402-52586085bb9f" returned: 0 in 0.420s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:38 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-528dfe83-aced-42a3-8c95-d971eaeb6d02 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "cinder-quobyte-0a120cde-7ff5-4a3c-9402-52586085bb9f" released by "delete_volume" :: held 0.941s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:38 devstack cinder-volume[81828]: DEBUG cinder.quota [None req-528dfe83-aced-42a3-8c95-d971eaeb6d02 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Created reservations ['ea3c905f-3eac-4230-91cc-ceb1276afd13', 'c61d62dc-2de6-49fc-b342-c022d551846a', '2876b719-28f0-4c53-b6ee-e42fa8e6042d', '2c0f5e73-53b0-4825-9bc4-d5744026aa89'] {{(pid=81828) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 25 16:01:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-528dfe83-aced-42a3-8c95-d971eaeb6d02 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 25 16:01:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-528dfe83-aced-42a3-8c95-d971eaeb6d02 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 25 16:01:38 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-528dfe83-aced-42a3-8c95-d971eaeb6d02 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf': None} {{(pid=81828) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 25 16:01:38 devstack cinder-volume[81828]: DEBUG cinder.volume.drivers.quobyte [None req-528dfe83-aced-42a3-8c95-d971eaeb6d02 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b4fdd565-ad12-45f3-ab54-23f525f78bdf'] {{(pid=81828) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 25 16:01:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.lockutils [None req-528dfe83-aced-42a3-8c95-d971eaeb6d02 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=81828) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 25 16:01:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-528dfe83-aced-42a3-8c95-d971eaeb6d02 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 25 16:01:38 devstack sudo[91548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1 Apr 25 16:01:38 devstack sudo[91548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 25 16:01:38 devstack sudo[91548]: pam_unix(sudo:session): session closed for user root Apr 25 16:01:38 devstack cinder-volume[81828]: DEBUG oslo_concurrency.processutils [None req-528dfe83-aced-42a3-8c95-d971eaeb6d02 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07957e07ca5366ff04e8679e0aa1b0a1" returned: 0 in 0.482s {{(pid=81828) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 25 16:01:38 devstack cinder-volume[81828]: DEBUG cinder.manager [None req-528dfe83-aced-42a3-8c95-d971eaeb6d02 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Notifying Schedulers of capabilities ... {{(pid=81828) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 25 16:01:38 devstack cinder-volume[81828]: INFO cinder.volume.manager [None req-528dfe83-aced-42a3-8c95-d971eaeb6d02 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Deleted volume successfully. Apr 25 16:01:38 devstack cinder-volume[81828]: DEBUG cinder.coordination [None req-528dfe83-aced-42a3-8c95-d971eaeb6d02 tempest-CreateVolumesFromSourceVolumeTest-215705290 None] Lock "cinder-0a120cde-7ff5-4a3c-9402-52586085bb9f-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=81828) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 25 16:01:48 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:UPDATE=235,cinder:DELETE=20,cinder:SELECT=146,cinder:INSERT=68 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 25 16:01:48 devstack cinder-volume[81828]: DEBUG dbcounter [-] [81828] Writing DB stats cinder:SELECT=170,cinder:INSERT=47,cinder:UPDATE=225,cinder:DELETE=18 {{(pid=81828) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}